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FOREWORD 



Contributing to an understanding of children's cognitive learning and im- 
proving related educational practices is the goal of the Wisconsin R & D Center. 
One of the Center's three major research and development programs — Conditions 
and Processes of Learning — consists of laboratory -type research projects, each 
concentrating on certain basic organismic or situational determinants of cognitive 
learning, but all united in the task of providing knowledge which can be utilized 
in the construction of instructional systems. 

One reason that computer modeling has proved to be a valuable approach to 

gaining knowledge of cognitive processes is that explicit questions are raised 

and must be answered — in programming. During the four years he spent modeling 
the concept attainment process. Professor Baker encountered increasingly complex 
questions whose answers required, finally, further basic research on learning be- 
fore he could proceed further in computer technology. His project generated many 
ideas for gaining knowledge about the psychological processes in concept learn- 
ing, research ideas to challenge the most inventive psychological experimenter. 
Although many questions remain to be clarified, the sophisticated model described 
in this Theoretical Paper represents a major forward thrust in computer technology. 

Herbert J. Klausmeier 
Director 
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PREFACE 



The pioneering work of the group at the Meilon-Carnegie Institute of Tech- 
no 10 ^- lead by A. Newell and H. A. Simon, had aroused considerable interest in 
non-numeric computing; however, the lack of readily available list processing 
languages limited the number of persons able to engage in this activity. In early 
196^, Dr. R. K. Lindsay and J. H. Dauwalder, the University of Texas, programmed 
IPL-V for the Control Data 1604 Computer, thus making it available to the Univer- 
sity of Wisconsin. With this new capability at hand, the present author decided 
to develop computer programs which simulated some aspect of cognitive behavior. 
Concept attainment was chosen for a number of reasons, paramount of which was 
that Dr. H. J. Klausmeier and his students at the University of Wisconsin had 
been working in this area far several years and would provide knowledgeable re- 
source persons; Hunt's book [1962] provided an entry into an unfamiliar litera- 
ture; and, finally, the concept attainment process appeared to be easy to simulate 
by means of a computer program. 

The first program, which I wrote myself in the fall of 1963, served primarily 
as a device through which IPL-V was learned. The experience gained from this 
program convinced me that much could be accomplished and a computer simula- 
tion project was written into the original R & D Center proposal. A long-term 
project in this area was planned during the summer of 1964 with support from a 
graduate school research grant, and many of the fundamental ideas were devel- 
oped that summer. Two years were spent in what seemed to be an endless loop 
of running subjects, writing programs, and redesigning the model. Since the 
initial program was written, considerable progress has been made; however, we 
are far from our goal of modeling the processes of human concept attainment. 

The purpose of the present final report is threefold. It is first to describe 
where we currently stand in our research efforts and perhaps provoke some re- 
search in the areas we feel are important. The second purpose is to provide 
others with some insight into the nature and magnitude of the problems a neo- 
phyte encounters when developing computer models of cognitive behavior. The 
third is to illustrate that the "state of the art" is very primitive and much remains 
to be done. 

I would like to emphasize the crucial role played by Mr. Tom Martin, who 
has programmed all but the first in the long series of programs. He has con- 
sistently worked to prevent the programs from becoming what programmers refer 
to as a “kludge" and has forced me to vastly sharpen my rather fuzzily conceived 
ideas. Many of my pet schemes have fallen apart and others have been coalesced 
into vastly improved schemes by his penetrating inquiries. He has also inde- 
pendently developed programs such as MIMIC which are significant contributions 
to the programming art themselves. 

Mr. Alan Pratt collected the first two sets of protocol data and Miss Carin 
Cooper has collected the remaining five sets. Miss Cooper has also thoroughly 
reviewed literature in simulation and memory, thus relieving me of a tedious 
task. Mrs. Eva Bradford conducted the planning experiment and prepared the sev- 
eral levels of program narratives. 

Although much remains to be done, this project has been terminated. The 
two reasons underlying this decision are: First, the “state of the art" limitations 



in psychological research have been reached, making it impossible to collect 
the type of data needed for this computer model. Second, my background is in 
psychometrics, statistics, and computers; but progress in the computer model 
requires a learning theorist and I did not wish to change my professional orien- 
tation to fit the needs of the project. I hope to pursue the linguistic model on 
an informal basis as the approach is too interesting to drop completely. 



F. B. B. 

Madison, Wisconsin 
1 September 1968 
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ABSTRACT 



Development of the model described in this final report was begun to obtain 
a better understanding of the psychological processes underlying human concept 
attainment. The model has been based upon theoretical grounds, "think -aloud" 
protocols, and speculations as to the nature of concept attainment. The model 
developed is embodied in a computer program written in the IPL-V language. The 
program exists primarily as a device for expressing complex ideas and relation- 
ships in a convenient form. The current version of the program, call jd Mark IV, 
Mod Z, exhibits a wide range of the behavior observed in the "think aloud" proto- 
cols obtained from human subjects. 

The model as currently developed consists of three major aspects: context- 
ing, operations, and memory. The contexting aspects of the model are concerned 
with the higher level cognitive behavior associated with selection of appropriate 
behavior, maintenance of goal-directed ness, and evaluation of completed be- 
haviors. Such functions were labeled contexting as the associated computer 
programs essentially analyse the current situation and define the context within 
which the operational routines are executed. The operational aspects of the 
model are those behaviors which are performed during the execution of a concept- 
attainment strategy. Such behaviors as creating a search criterion, comparing 
objects, ami presenting concepts were considered operational. The memory com- 
ponent of the model was designed to facilitate the other aspects of the model as 
well as form the basis for a model of human memory. The memory was divided 
into three types of storage, each used for a particular purpose. The working mem- 
ory was a buffer-type memory which received information from the external world 
and acted as a communication device for the transfer of internally created infor- 
mation. The short-term memory contained all of the information relevant to the 
attainment of a particular concept. The short-term memory was constructed as 
a "circular memory structure" with a modular format; such a structure enables 
memory to grow as information is created. The long-term memory will retain 
learning strategies and descriptive information necessary to implementation of 
these strategies. 

On the basis of the present model it appears that the most fruitful area of 
future inquiry would be development of a computer model in which the higher 
level information processing is handled at a verbal level. Such an approach has 
been labeled a "linguistic model of concept attainment." The salient features 
of the linguistic approach have been discussed but the corresponding computer 
programs not written. 

Because existing psychological theories and published research do not pro- 
vide the types of information necessary to further development of the model, a 
number of areas of fruitful research have been described. For example, the model 
suggests that the majority of the information processed by human subjects is in- 
ternally created; hence new techniques are needed to elicit this information. 

When compared to earlier versions, the current model h«.s considerable power 
ami seems sophisticated; however, when compared to human concept attainment 
it is very rudimentary. Hopefully the current model can serve as the basis for 
further interesting research. 



xi 
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I 

INTRODUCTION 



GOALS OF THE PROJECT 

The fundamental purpose of the present 
project has been to obtain a better understand- 
ing of the psychological processes involved 
in the attainment of concepts by humans. The 
particular vehicle through which these under- 
standings have been acquired is that of com- 
puter programs which serve as models of the 
concept attainment process. The use of com- 
puter programs as models of cognitive behavior 
has its origins in the early work of Newell, 
Shaw, and Simon [1958] who proposed tnat the 
"Logic Theorist" program was a model of human 
problem-solving behavior. Later work by this 
group and others has resulted in a well estab- 
lished field which is generally called simula- 
tion. But because the word simulation is 
widely used in fields other than psychology, 
most authors currently prefer to use the term 
computer models. The use of computer pro- 
grams to represent a psychological process 
involves a number of factors which make the 
technique extremely valuable. First, because 
of the small steps by which computers proceed, 
it is difficult to write programs for something 
which is ill-defined. Hence, the computer 
farces one to probe very deeply into a psycho- 
logical process in order that it be understood 
well enough to be programmed. Second, the 
computer program can be manipulated in a 
number of ways such that it can assist one in 
understanding the ramifications of the avail- 
able knowledge about the processes involved. 
Third, the computer program serves as a repos- 
itory of the understandings one has acquired 
up to any given point in time. The ideas are 
preserved in a language form which is unam- 
biguous and open to study by others. Fourth, 
in any modeling process one is forced to make 
assumptions and in a computer program it be- 
comes quite apparent what role these assump- 
tions play in the model. Briefly, the computer 
serves as an extremely strict task master who 
forces one to commit to paper what one under- 
stands and, more importantly, what one does 
not understand. 



Because one can approach a problem from 
many points of view the emphasis in a project 
of this type is a function of the interests of 
the investigator. In that the present author is 
firmly committed to "process" psychology rather 
than S-R psychology, no attempt has been made 
to study the relation of the model to stimulus 
materials. The interest here is in How a human 
subject performs the concept attainment task, 
not in what variables the experimenter can use 
to manipulate the subject's responses. Using 
S-R terms, the attempt is to model the inter- 
vening variables not the gross S-R connections. 
In the long term an understanding of the internal 
processes of a human subject holds consider- 
ably more promise for yielding new teaching 
techniques, classroom materials, etc. than 
does the traditional S-R approach. 

At the present time there appear to be two 
general approaches to the design of a computer 
model of cognitive behavior, and these are 
referred to below as the basic premise approach 
and the surface approach (see Baker 1967). 

Under the basic premise approach one postu- 
lates a minimum set of operational rules or 
procedures and then designs a computer pro- 
gram around the successive application of the 
basic premises or their derivatives to the data 
presented in the F:i,jram. The underlying idea 
is to ascertain how much interesting behavior 
can be generated by a set of basic premises 
deviseb by the investigator. Computer pro- 
grams which perform pattern recognition [Uhr 
and Vossler, 1961], the sequence learner of 
Simon and Kotov sky [1963], and the concept 
learning system [Hunt, Marin and Stone, 1966] 
are clearly of this type. Such programs assume 
that a human has the basic premises and the 
ability to apply them built in or acquired from 
Past experience, and that the investigator has 
made a reasonable assumption as to what basic 
premises are involved. An additional some- 
what contradictory assumption usually involved 
in such programs is that the program, i.e. sub- 
ject, begins a given computer run with no past 
experience relative to the data it will process 
by means of the basic premises, the "clean- 
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si “ assumption. A considerable amount of 
intelligence, to u3e the term loosely, is bui.lt 
into the program in regard to how to process 
the ;ata, but none is built into the program in 
regard to previous nations of the data. 

The resulting behu v;r of such a program is 
typically tne construction and modification of 
decision-trees which are completely dependant 
upon the sequence of data fed into the program. 

The surface approach tends to be asso— 
elated with computer programs cased upon 
human "think -aloud" protocols [Leughery and 
Gregg, 1962; Johnson, 1964). Under this ap- 
proach one attempts to use the p-otocols to 
ascertain the gross behavior oatterns of humans 
in a particular problem-solving or learning 
situation and then to write computer programs 
which reproduce these gross behaviors, ouch 
pregrams can usually reproduce the overt be- 
haviors observed in humans, and the computer- 
generated protocols can be reasonable fac- 
similes of corresponding human protocols under 
the sa*.e conuitlons. In contrast to the basic 
premise approach, the surface approach does 
not postulate any specific underlying mechan- 
isms; rather it follows some well defined 
overall plan, such as the concept-attainment 
strategies of Bruner, Good now and Austin [1956). 
in addition, it does not make the clean-slate 
assumption of the former in that knowledge 
about die data known to be relevant to a par- 
ticular phoncmenon is built into the program. 

In that so little is known about how hu- 
mans solve concept— attainment problems , it 
was not felt appropriate to make the assump- 
tions necessary for the basic premise approach. 
In addition, if one follows the basic premise 
approach, one has very little likelihood of 
discovering new understandings cr obtaining 
new insights as the total system is based 
upon a preconceived set of basic premises. 
However, starting from a suriace-type approach 
one can change the system to match the new 
understandings acquired as one digs further 
into the problem rather than being constrained 
by an artificial set of initial basic premises. 
Throughout the current project a surface-type 
approacn has been followed, but this is not 
to say that basic assumptions concerning suen 
things as memc ry and other facets were not 
made. However, these assumptions have nor- 
pially grown out of difficulties encountered 
within a computer program rather than being 
preconceived assumptions about the process 
itself. 

In view of the Investigator's commitment 
to the surface approach, n method of attack 
has been developed which allows one to elicit 
as much information as possible from the con- 



struction of die compute* program and at the 
same tine "keep control" of the computer model. 
The procedure followed is given in the para- 
graphs below. 

One begins with a computer program which 
corresponds to the behavior of an intelligent, 
experienced subject performing a particular 
type of concept-attainment problem after hav- 
ing hod considerable practice. One then slowly 
builds into the model various types of behavior 
which are not as efficient as those used by the 
experienced subject and thus degrades the per- 
formance of the computer program. What one 
attempts to do is work backwards toward a 
computer program which will be as inefficient 
and stumbling as a person attempting the prob- 
lem for the first time. By deliberately intro- 
ducing a particular change into the computer 
program and then observing how the subject's 
performance of the task has been degraded by 
that change, one gets an understanding of the 
ramifications of each change made to the com- 
puter model. Such an approach is somewhat 
at variance with a large number of other simu- 
lation projects which have attempted to write 
a computer program for a subject who is ini- 
tially very inefficient and inept at solving a 
problem and then improves to the performance 
level of an experienced subject. The latter 
approach appeared to the present author to be 
a more difficult task as at the current state of 
knowledge one does not have a good grasp of 
what causes the subject's inefficient, inept 
performance. It seemed much more appropriate 
to start from the experienced subject and slowly 
work backwards with a good understanding of 
each backward ste? and its effects upon per- 
formance. Thus , the amount of variability in 
the behavior built into the computer program 
is a function of our understanding of the con- 
cept attainment process. Eventually the com- 
puter program would become as inefficient as 
a human attempting a problem for the first 
time, but at that point one would understand 
the reasons for this level of performance and 
tha processes by which a subject improves 
his performance over a sequence of problems. 
Then, one would expect to have an extremely 
good model of the concept-attainment process 
which could serve as a guideline for further 
educational-psychological investigations in 
the classroom. 

The so-called backward approach has 
proved to be very feasible and quite rewarding 
in terms ox the understandings of the concept- 
attainment process we have been able to ob- 
tain. The backward approach allows one to 
continually tie the computer model back to 
actual subject behavior and to insure that 
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what has been built into the computer program 
does in some manner represent actual subject 
behavior. It does not imply that the mechan- 
isms are true representations of the subject’s 
internal processes; however, the external be- 
havior of the program can be observed in subject 
behavior. 



THE EXPERIMENTAL SITUATION 
TO BE MODELED 

The tvpe of experimental situation for 
which a computer model has been developed 
is that described by Bruner, Good now and Austin 
[1956] and used extensively by psychologists. 

In such experiments, a subject is seated before 
a board containing a number of objects. Each 
object contains m dimensions and each dimen- 
sion has h values; thus a complete board has 
n m different objects. The experimenter ex- 
plains to the subject that the objects can be 
divided into two mutually exclusive groups, 
members and nonmembers of the set defined by 
a classification rule (concept) consisting of a 
particular combination of dimension values. 

The experimenter designates an object (the 
focus object) as a member of the set. The 
subject's task is to discover the classification 
rule by choosing objects and having the ex- 
perimenter designate their set membership. 

When the subject feels he knows the under- 
lying classification rule, he tells it to the ex- 
perimenter. If the rule is correct, it is assumed 
that the concept has been attained; if not, the 
subject continues until he can present the cor- 
rect classification rule. 

Bruner, Goodnow and Austin [1956] iden- 
tified and labeled a number of strategies which 
subjects employed in this experimental situa- 
tion and two, the "conservative focusing” and 
"wholist," are of interest to the present paper. 
Using the conservative focusing strategy, a 
subject chooses an object from the board 
identical to the focus object except for one 
dimension whose value has been varied. When 
such an object is designated as a member of 
the set, a "yes'* object, he knows that the 
dimension is not included in the classification 
rule, hence is irrelevant. If the object so 
chosen is designated as not being a member 
of the set, a "no" object, he knows that the 
dimension is relevant, the dimension value of 
the focus object is included in the classifica- 
tion rule. In the conservative focusing strat- 
egy, the subject varies one dimension at a 
time and systematically checks each of the m 
possible dimensions. Thus, the minimum ‘ 
number of object choices to attain the con- 
cept is m , the number of dimensions. 



Using the whciist strategy, the subject 
determines the classification rule through the 
intersection of all objects designated as mem- 
bers of the set by the experimenter. If an ob- 
ject chosen by the subject is designated as a 
member of the set, it will have certain dimen- 
sion values in common with the focus object. 
Thus, a "yes" object is of value to the subject 
and a "no" object is of no value under this 
strategy. The subject continues developing 
the intersection of e series of "yes" objects 
and the focus object until he feels he knows 
the concept. Typically, under this strategy, 
subject will present a concept for designation 
by the experimenter after each "yes" object. 

Although both strategies had a concept 
attainment, they differ in two major aspects. 
First, the method for choosing objects under 
the conservative focusing strategy is well 
defined and quite obvious to the observer, 
whereas under the wholist strategy the object 
choice mechanism is not so clearly observable. 
Second, the meaning of a "yes" and "no" desig- 
nation of an object choice is reversed in the 
two strategies. In the conservative focusing 
strategy a "no" is the desired designation, 
and in the "wholist" a "yes" is the desired 
designation. Programs Tor both of these strat- 
egies were developed in the present project, 
but the primary emphasis has been upon the 
conservative focusing strategy. 



DEVELOPMENT OF THE 
COMPUTER MODEL 

The books by Bruner, Goodnow, and Austin 
[1956], Miller, Galanter and Pribram [1960], 
and Hunt [1962] and journal articles on the 
concept-attainment process were read to de- 
velop some understanding of what others had 
done in the concept-attainment area. On the 
basis of this initial investigation and the 
author's own intuitive understanding of how 
he would solve a concept-attainment problem, 
a computer program was written which would 
"simulate" concept attainment. The initial 
computer program called Mark I, Mod O was 
published in early 1964 [Baker, 1964]. On the 
basis of this program protocols were collected 
to ascertain how sophomore subjects from the 
University of Wisconsin, who had not pre- 
viously seen this kind of problem, would solve 
it. The "think-aloud" procedure was used to 
collect data which was then analyzed by the 
project staff. On the basis of the analysis 
of the protocols, it was determined that the 
majority of the subjects very rapidly developed 
a conservative focusing strategy. Therefore, 
the computer program was redesigned to 
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incorporate c conservative focusing strategy. 

A computer progiant to model a specific subject 
has not been developed; rat ler many subjects, 
both male and females, have been uued and 
the " normative “ behavior of the subjects was 
modeled. 



TH1NK-AL0UD PROTOCOLS 

The data gathering device used throughout 
the project has been the think -aloud protocol. 
As the experiment is being run, the subjects 
verbalize what they are doing ana v/hy they 
are doing it. Such a procedure has been a 
standard practice among those developing 
simulation programs even though it is not held 
in high esteem in many psychological circles. 

It was found quite early that the raw protocols 
were not very rich in information and a modi- 
fied system was adopted in which the experi- 
menter asked preplanned questions at certain 
points within the problem The questions arose 
from the computer program and were designed 
to help fill the gaps in the program. For ex- 
ample, at one point the interest was in whether 
subjects remembered specific object choices, 
thus after the fifth object choice, they were 
asked to identify the second object chosen. 
Such information would not be yielded by the 
usual protocols, yet is easily obtainable 
through selective interrogation. A total of 
seven sets of protocol -gathering sessions, 
each involving five male and five female sub- 
jects were conducted, tape recorded, and re- 
produced in mimeographed form. In each of 
these seven runs a different set of questions 
was used to aid in development of the com- 
puter program. 

Analysis of the early protocols revealed 
that the materials used by Bruner et al. 1.1956] 
and Klausmeier, Harris, and Wiersma 
involved psychologically dependent dimen- 
sions; subjects were unable to treat shape as 
an independent dimension. To overcome this 
problem new materials, consisting of animals 
whose dimensions were ears (long-short), 
neck (long- short) , body (thin-fat), color 
(yellow-blue-brown) and tail ( straight-bent- 
curly) were devised. Figure 1 presents one 
of the 72 possible animal configurations. 

Two of the dimensions were three-valued to 
overcome the artificiality of all binary valued 
dim- 'sions. The new materials proved very 
successful and wore used throughout the re- 
mainder of the project. 




UTILIZING THE COMPUTER PROGRAMS 

After writing a computer program to model 
the behavior of the subjects in the concept- 
attainment task, one spends a considerable 
amount of time analyzing the computer program 
itself in order to reduce it to a simple struc- 
ture. It is very easy to become trapped with 
a computer program which is so complex and 
clumsy that it does not lend itself to the con- 
tinual modification required by the so-called 
backward approach. Therefore, extreme care 
has been exercised to avoid a situation which 
requires periodically starting from the beginning. 

A vast amount of effort has been devoted 
to the mechanics of the computer program it- 
self in order to facilitate the modeling process. 
Data representation schemes, methods of com- 
munication within the computer program, and 
methods of executing the computer programs 
representing various types of behavior have 
been devised. What has been developed is 
essentially a small computer programming 
system within which a model of the concept- 
attainment process may be developed. Strange 
os it may seem, much of the understanding of 
the concept-attainment process has arisen 
out of attempts to develop a systematic com- 
puter program for use in the modeling process. 
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After a particular version of the computer 
program has been reanalyzed, rewritten, and 
polished to the point where it is a reasonable 
representation of our current understanding of 
the concept-attainment process, considerable 
effort is devoted to looking at the points where 
insufficient information exists. Questions are 
then devised to be asked during the next proto- 
col run which will help clarify the particular 
point of concern. Thus, a large feedback loop 
exists in which attention shifts from subjects 
to computer program, to subjects, and then to 
the computer program again. 



SlftfrfARY 

The goal of the present project was to 
develop a model of the various cognitive proc- 
esses involved in human concept attainment, 



and it was toward the end of understanding 
these processes that the above procedures 
were directed. A lesser interest was in a 
computer program which would be an interest- 
ing tool in developing further understandings 
and insights into the concept-attainment process. 
There was little concern with developing a 
computer program which could generate large 
amounts of interesting data for later analysis 
or reporting in "See what our computer program 
can do" fashion as has been so typical of 
Past efforts. The computer program is con- 
sidered to be a repository of ideas about the 
processes involved in concept attainment 
expressed in computer programs in the IPL-V 
language. Recording ideas in this way may 
seem peculiar, but in a problem as complex 
as concept attainment it is virtually impos- 
sible to verbally represent all of the facets 
involved. 
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II 

A COMPUTER MODEL OF THE CONCEPT* ATTAINMENT PROCESS: 

CASE MARK IV, MOD 2 

> 



INTRODUCTION 

In this chapter several levels of descrip- 
tion of the most recent model of the concept- 
attainment process produced by the project 
staff are provided. One level will be rather 
gross so that the internal structure of the pro- 
gram can be seen without the clutter of mechan- 
ical details. The second will be at the sub- 
routine level to provide the reader with some 
appreciation of the formidable problems faced 
in implementing a computer model of cognitive 
behavior. In order to present the latter level 
it is necessary to discuss various mechanical 
details underlying the actual computer program. 
A full understanding of the model can only be 
obtained through a detailed study of the listing 
of the computer program which is presented in 
Appendix B. Although the computer program 
has been written in IPL-V [Newell, et al. , 

1964]* a serious attempt has been made to 
describe the program without involving more 
than a bare minimum of the IPL-V language. 



Assumptions 

In order to program the present model a 
certain number of assumptions were made. 

The foremost of those was that the subject's 
perceptual processes are perfect; thus, the 
processes of perception were ignored. Even 
though a large proportion of the errors made 
in the concept-attainment process can be 
attributed to perceptual errors of one type or 
another they were not modeled. Secondly , 
the assumption has been made that memory 
is perfect; i.e., the computer model does not 
contain any forgetting processes. At some 
later point in time, it is anticipated that both 
decay and interference-type forgetting can 
be introduced into the computer program, but 
at the current time such mechanisms would 
obscure other more crucial aspects. 

A major effort in the development of this 
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computer model has been devoted to elimi- 
nating the necessity for large numbers of input 
parameters and prestored information. At the 
current time only three types of information 
are prestored for use by the computer program. 
One of these is the dominant dimension values. 
Analysis of the initial protocols indicated that 
subjects possess a preference for certain di- 
mensions and certain values of these dimen- 
sions. For example, it was found that female 
subjects invariably will utilize the dimension 
of color rather early in the solution of their 
problem, and certain people will prefer yellow 
over blue or brown. Built into the computer 
program is a selection device based upon prob- 
ability values assigned to the dimensions and 
to their values. However, this information is 
used only at one point in the computer program 
and is not crucially involved in many of the 
psychological processes. It should be noted, 
however, that considerable variability in be- 
havior can be accounted for by these dominance 
values. Three constants have also been pre- 
stored in the program which help mechanize 
certain types of within-problem variability. 
These constants are associated with the num- 
ber of dimensions that a subject will use during 
a particular concept-attainment problem and 
the number of dimensions he will add to his 
initial approach when he discovers that it has 
not worked. The third and final prestored 
parameter is one known as an awareness factor. 
The protocols have indicated that many sub- 
jects use less than the total number of dimen- 
sions in their problem solution and that some 
of these people are aware of the fact that they 
are using less, others are not. Therefore, a 
flag is used to indicate whether the subject 
is aware that he is using less than the full 
n u mber of dimensions in his approach to the 
problem. Other than these three types of in- 
formation, all data gained by the subject is 
stored in memory as it is either received from 
the external world or created by the subject 
himself. 
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Representing Cognitive Process 

In order to describe the computer model 
of the concept-attainment process it is neces- 
sary to explain a certain amount of symbolic 
representation used internally by the computer 
program. In that this project was influenced 
quite heavily by the earlier work of Bruner et al. 
[1956 1 ami that of Miller, Galanter and Pribram 
[I960], the program is built around the idea of 
strategies, and the mechanics of the program 
are designed to implement strategies or plans. 
Quite early in the project it was discovered 
that the programming system must have the 
capability to minimize the impact of significant 
changes and simultaneously to maximize the 
ability to make such changes. Therefore, a 
pseudocode system ami an interpreter, both 
using IPL-V, were developed as a reasonable 
solution to this technological problem [Baker 
& Martin, 1965a]. 

The strategy consists of an IPL-V list 
containing symbols representing routines which 
are to be performed as well as local symbols 
which indicate branches in the program. These 
lists, however, do not contain any IPL-V prim- 
itives and are not executable IPL-V programs. 
Table 1 contains a list of symbols representing 
a typical concept-learning strategy. 

Each symbol on the list can be the name 
of a list of symbols; this representational form 
can be carried to any depth desired. These 
symbols are referred to as pseudocodes as 
they are merely abstract representations of 
psychological processes. In the current pro- 
gram there are three levels in the list structure 
which constitute a learning strategy. The 
highest level, the S level, is essentially an 
executive level description of the overall 
learning strategy. The second level consists 
of major procedures, the Z or D routines, which 
perform salient tasks such as hypothesis gen- 
eration. The third and lowest level are the P's 
and Q's which are executed to perform the in- 
formation-processing tasks necessary for 
concept attainment. The P's and Q's are con- 
tained within the Z's and D's and the Z's and 
D's are contained within S. Throughout the 
list structure a distinction is maintained be- 
tween programs which do things, the Z's and 
P’s, and those which provide decision-making 
information, the D's and the Q's. The former 
are analogous to the O routines and the latter 
to the T routines in TOTE units [ Miller et al. , 
I960]. Only the lowest level routines can re- 
sult in the direct execution of subroutine 
coded in IPL-V, and the higher levels serve 
only to hold together various combinations of 
executable routines. The underlying principle 



Table 1. Symbolic Representation of the 

Conservative Focusing Strategy List 
as Used in Mark IV, Mod 2 



S2 9-0 




zo 


Process focus information 


C21 


Create procedure Z7 


LI 


Establish search criterion 


D4 


Determine whether subject 
should proceed 


9-2 


No, error exit 


9-1 Z1 


Construct search criterion 


Z2 


Select object from external 
environment 


C37 


Create decision procedure D1 


DO 


Determine whether object 

selected meets subject's needs 


9-1 


No 


Z3 


Experimenter designates set 

membership of the object choice 


C38 


Create routine Z4 


Z4 


Process information gained 
through object designation 


D1 


Determine whether a concept can 
be presented 


9-1 


No 


Z5 


Form a concept 


Z8 


Experimenter designation of 
correctness of concept 


C22 


Construct procedure Z6 


Z6 


Subject's reaction to designation 
of concept 


D3 


Determine correctness of concept 


9-1 


No 


0 0 


Yes 


9-2 X21 
0 0 


Error exit 



is that the P's and Q’s are the basic informa- 
tion processing capabilities possessed by a 
subject, and various tasks are performed by 
assembling the proper s guertce of P's and Q's 
into the Z : s or D's. The Z's and D's are then 
assembled into the strategy list (S). Such a 
strategy list is then executed by a special 
purpose interpreter [Baker fit Martin, 1966a] 
which works its way through this list st. ..cture 
until it finds a routine which is executable, 
namely at the lowest P or Q level. It executes 
the routine and then returns up to the next 
higher level to ascertain the next executable 
routine. Fundamentally the interpreter is an 
ordinary IPL-V recursive program which calls 
upon itself to work its way up and down the 
branches of the list structure representing the 
learning processes. 
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Memory Structure 

Quite early in the development of the 
concept attainment program, it was determined 
that memory plays a crucial role in the concept - 
attainment process, and it was necessary to 
design a rudimentary model of memory. Under 
this model, memory was divided into three 
major aspects: working memory (WM) which 
is a temporary, buffer-type memory; short-term 
memory (STM) in which all information relative 
to a given problem solution is stored; and long- 
term memory (LTM) where the subject stores 
information which is to be retained over a 
longer period of time. Thus, the partitioning 
of memory is a function of the duration of time 
over which the information is to be retained. 
Such a three-part memory does not correspond 
directly to the memory model ordinarily used 
by psychologists, which involves only a short- 
term memory and a long-term memory. Most 
of the functions of what was called short-term 
memory are embodied in their long-term mem- 
ory. However, investigation of the protocols 
seems to indicate that subjects retain informa- 
tion about a problem only long enough to solve 
that particular problem and then do some re- 
coding to save the salient features over longer 
periods of time. Therefore, it was suggested 
that there is a distinction between short-term 
and long-term memory which psychologists do 
not normally recognize. 

The short-term and long-term memories 
have a highly interconnected net structure 
which is developed by the program as informa- 
tion is acquired. The dynamic nature of the 
memory structure is an important feature of 
the three-level model, but discussion of the. 
actual mechanics of this system will be de- 
ferred to a later section in the present paper. 



The Contexting Hierarchy 

The internal organization of computer 
models constructed under either the basic 
premise or the surface approach is focused 
upon implementing a rather specific psycho- 
logical phenomena and does not take into 
direct account a higher level of cognitive be- 
havior, namely that which in come sense 
directs, maintains, ami evaluates the overall 
problem-solving or learning behavior of a 
human subject. 

In order to clarify this issue, let us briefly 
examine a problem-solving or learning experi- 
ment as it is usually conducted. In such an 
experiment there is a fairly typical sequence 
of events which transpire in roughly the fol- 
lowing order-. 



(a) The experimenter explains the nature of 
the task, the characteristics of the ex- 
perimental materials, and the types of 
products the subject is to produce. 

(b) The subject relates the given information 
to wha f he already knows. 

(c) Once the subject has assimilated the in- 
formation to his own satisfaction, he em- 
barks upon an approach to the task which 
is resplendent with errors and inappropriate 
decisions; fal ;e strategies, and unproduc- 
tive acts; nonetheless, his behavior is 
goal directed. 

(d) The subject is able to evaluate, in some 
sense, how well he is doing by means of 
both internal and external clues. 

(e) With sufficient experience on the same 
task, the subject is usually able to modify 
his own behavior to the point where he 
becomes proficient at the task and his 
once clumsy performance becomes smooth 
and effortless. 

In that such a pattern of behavior is es- 
sentially independent of the particular task, 
it is very difficult, for the present author at 
least, to conceive of a realistic model of 
human behavior whose internal organization 
does not provide for some form of a central 
executive to account for this communality. 

The relevant issue is the form of this central 
executive and the Internal organization of a 
computer program necessary to represent it in 
a computer model of cognitive behavior. Un- 
fortunately, it is extremely difficult to obtain 
direct evidence from either protocols or psy- 
chological experiments from which to develop 
a model of such a central executive. In addi- 
tion, how to create one is not obvious; as 
Newell (.1962] said, "In attempting to create 
such a central organization we found — as we 
had in the problem of communicating strat- 
egies — that we had no concepts and no formal 
language to discuss the variety of results and 
their uses [p. 410].” 

In earlier editions of the program such a 
central executive was confounded with the 
strategy list; however in the current version, 
the supervisory or executive aspects of the 
program have been separated from those of 
the operational aspects. The C routines repre- 
sent this executive function and constitute a 
hierarchy of control whose role changes as a 
function of the stage of the task performance. 
Because the function of the supervisory pro- 
gram changes often, the term contexter is 
probably more appropriate for these routines 
than central executive , which carries an un- 
warranted connotation of a single supervisory 
program. Although the role of a contexter is 



a function of the situation in which it operates, 
there is nonetheless an unaerlying communal ity 
throughout all levels of contexters which can 
be described by a series of questions which 
a context routine attempts to answer; i.e., 

(a) What is the current situation.'’ (b) What 
does it mean.'' (c) What could be done ? and 
(d) What will be done? Thus, whether the 
contexter is dealing with a gross overall plan 
of approach to a task, or to some small opera- 
tion within a subtask, the fundamental frame- 
work of a contexter routine is invariant; what 
varies is the situation in which the contexter 
functions and the procedures by which it at- 
tempts to answer these questions. It is worth 
noting that the definition of the current situa- 
tion includes not only the available data but 
also the sequence of behaviors leading up to 
the present point in time. The result of calling 
a contexter routine is to execute some behavior 
for which an appropriate context has been es- 
tablished. 

A contexter may be said to create a plan or 
a strategy for behavior. At high levfels in the 
model, it creates a plan for overall behavior 
such as the S list, and at low levels it creates 
plans for very specific actions such as P lists. 
Such a planning hierarchy was first envisioned 
by Miller, Galanter, and Pribram [I960] when 
they suggested the existence of plans which 
create plans. Because of the rather complex 
interrelationship between the contexting pro- 
grams and the strategy lists, a detailed dis- 
cussion is deferred to a description of the 
actual computer program itself. 



THE CURRENT PROGRAM-MARK IV. MOD 2 

The preceding paragraphs have acquainted 
the reader with some of the major considera- 
tions in the design of the simulation program; 
the overall picture of the operation in the cur- 
rent version of the computer model of concept- 
attainment is as follows. First, the experi- 
menter verbally describes the experimental 
situation to the subject — what the experiment 
is about, what the board looks like, the dimen- 



sions on the board, and their values. The 
experimenter also indicates to the subject 
that he is to select objects which the experi- 
menter will designate as to their set member- 
ship. When the subject feels ho understands 
the concept, he is to present it to the experi- 
menter for designation. Upon receipt of the 
instructions, the subject proceeds to try to 
attain the concept. The computer program is 
set up with an initialization phase which 
utilizes the subject's past experience and 
his particular characteristics, namely some of 
the constants mentioned earlier and the dom- 
inance values, to establish an initial set of 
conditions within the subject. After completing 
this initialization phase, the computer program 
creates a search criterion and locates an ob- 
ject in the external environment which ,'t also 
feels is a member of the set. If the object 
found meets the requirements of the subject's 
search criterion, it is presented to the experi- 
menter for designation. After receiving the 
designation, the subject processes the meaning 
of yes or no in light of his own understanding 
of the problem. If the subject feels he can 
present a concept he proceeds. However, in 
most cases the subject takes several object 
choices before he has enough information 
available to decide whether or not he under- 
stands the concept. Therefore, at this stage, 
the computer program returns to creating a new 
criterion and locates other objects from the 
board visible to the subject. The final phase 
of the program occurs when the subject feels 
he has enough information to present the ex- 
perimenter with a concept for designation. If 
it is incorrect, the subject then has to con- 
struct a reaction to this incorrect designation 
and return to the first phase in which he 
searches for additional objects that will en- 
able him to ascertain the correct concept. If 
the concept is correct, the problem is ter- 
minated and the subject then evaluates what 
he has accomplished during the course of this 
particular problem. So much for an overview 
of the concept-attainment process. Let us 
now turn our attention to a discussion of the 
flow chart which is given in Figure 2. 
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Exit 



Fig. 2. Flow Chart of the High Level Contexter List S3 
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Iras flow chart will be discussed in terms 
of the particular routines which are in the flow 
chart. No attempt to go into all the program- 
ming or mechanical details is made* but a 
verbal description of what occurs within the 
program is given and any relevant assumptions 
which have been made by the particular pro- 
gram are indicated. The highest level program 
list m the computer model is called Si which 
is the high level contcxting list. This program 
essentially contains a gross description of 
what is to occur in the attainment of a concept 
and consists of four computer programs: Cll, 
which creates a tentative strategy from the 
experimenter's instructions; E95 in which the 
experimenter presents the focus object to the 
subject; Cfel which creates and executes a 
strategy phasc-by-phase until the concept is 
finally attained; and Cl 2, a problem solution 
postmortem analysis in which the subject ties 
together what he has done into a workable 
learning strategy for future use. It should be 
noted that Cl 1 , C61 , and C12 are contexting- 
type routines. 

The messages from the experimenter ex- 
plaining the problem to be solved have been 
coded in terms of attributes and particular 
attribute values which essentially describe 
major behaviors; such coding gets around the 
syntactical-semantic analysis problems nor- 
mally associated with translating English lan- 
guage into a computer program. This particular 
problem was completely by-passed because it 
is a major research project in itself. Rather, 
experimenter messages have been created 
describing behavior in terms of attributes and 
values so that the long-term memory can be 
searched to see whether other behaviors carry- 
ing this description are available for assembling 
into a strategy. Such an approach is rather 
crude, but it enables a form of translation of 
instructions to behavior to be introduced^ into 
the model. 

The Cll routine accomplishes the trans- 
lation of experimenter messages to a descrip- 
tion of a rough skeleton learning strategy. In 
the first problem attempted by a subject, the 
Cll routine creates a skeleton strategy list 
which describes the gross behaviors neces- 
sary to attack this concept-attainment problem. 
In subsequent problems, Cll searches the 
long-term memory to obtain a strategy list 
from a previous problem which can be utilized 
as the approach to the problem. Cll consists 
of three major subrou tines, each one asso- 
ciated with a different type of message which 
can come from the experimenter. The first 
subroutine, called C50, creates a problem 
list, indicates what the problem is, and stores 
descriptive information such as which problem 



it is. The second subroutine, called C5 1 , cre- 
ates a description of a skeleton strategy for 
solving the problem. The skeleton strategy 
does not include all of the behaviors necessary 
to attain the concept, but stores the major 
framework of the experimental situation con- 
tained in the experimenter's messages. The 
third major subroutine, C52, is designed to 
store specific types of information which the 
experimenter presents, such as that he will 
designate set membership of an object by the 
words yes and no. Thus, Cll takes in a par- 
ticular message from the experimenter's verbal 
instructions and translates it into descriptions 
of particular behaviors which the subject must 
perform in order to attain a concept. Which of 
the three C50 routines used is a function of 
the message that has been received from the 
experimenter, and there are decision processes 
within Cll enabling the program to call the 
proper subroutine for a given message. There 
are two major outputs of the Cll routine, one 
of which is the beginning of the short-term 
memory structure which the program will grow 
during its solution of the concept-attainment 
problem. The second is a skeleton strategy 
list containing symbols representing the major 
procedures within the concept— attainment task 
as indicated by the experimenter. The initial 
point of the short-term memory, the symbol 
L100, represents the problem and carries the 
description of the problem obtained from the 
experimenter messages. The skeleton strategy 
list contains symbols which are not executable 
routines at this point, but are merely symbols 
which hold descriptions of the kinds of be- 
haviors necessary to accomplish the task. If 
the subject has previously attained a concept, 
rather than constructing a skeleton strategy 
Cll locates the recently used strategy in long- 
term memory and places its name in memory. 

When Cil has been completed the subject 
knows in a general way how he is to perform 
the concept-attainment task. To specify a 
particular concept-attainment task, the ex- 
perimenter must identify the focus object, 
which is an exemplar of an object belonging 
to the set defined by the unknown classifica- 
tion rule. Routine E95 performs this function 
by placing the name of the focus object in the 
subject's working memory. The name of the 
focus object is accompanied by descriptive 
information indicating the set membership of 
the focus object. Upon completion of this 
action, control of the program returns to the 
subject. 

The major contexting routine in the current 
program follows E95 and is called C61. At the 
time this routine is executed, the short-term 
memory contains the symbol LI 00 which 
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represents the problem to be solved, and the 
contents of the working memory are either the 
name of the skeleton strategy or a previously 
developed strategy. The routine checks a flag 
to determine whether this is the first problem 
it has solved or not. If. it is not the first prob- 
lem, C61 assumes that the contents of working 
memory are a fully developed strategy which is 
given to the interpreter for execution. If it is 
the first problem, th> program must translate 
the description cf the skeleton strategy cre- 
ated by Cll into executable behavior. The 
C61 routine creates a symbol for the strategy 
list and then creates a symbol for the first 
phase of the strategy. Having created a phase 
symbol, it then searches long-term memory to 
find a routine whose behavioral description 
matches that of the first routine on the skele- 
ton strategy list. In this situation it will be 
routine ZO which receives the focus object and 
its designation from the experimenter and 
stores them on the problem list. Because ZO 
receives information from the external environ- 
ment, it is followed by a context! ng routine. 

It should be noted that one of the rules of the 
computer program is that a contexter routine 
follows whenever information is received from 
the external world. In this case contexter C21 
is inserted on the phase list after routine ZO. 
The function of the contexter C21 is to create 
routine ZT which uses the focus object and 
characteristics of the subject to establish the 
initial working hypothesis. Because C21 will 
create routine Z7 at execution time, the C61 
contexter will place a symbol on the phase 
list to hold a position for this future routine. 
The symbol for Z7 is followed by routine D4 
whose function is to determine whether the 
information yielded by Z7 is adequate. If it 
is adequate, the next phase can be constructed; 
if inadequate, C61 will have to attempt to cre- 
ate a new Phase 1. The basic process em- 
bodied in C61 is one which creates a phase 
list containing routines matching the behaviors 
described by the experimenter. Routines pro- 
cessing information from the external world 
are followed by decision routines which ask 
"Can the strategy proceed?" These decision 
routines also terminate the phase list. Thus 
C61 creates a phase, executes it, and, if it 
receives the go-ahead, creates the next seg- 
ment of behavior. 

Phase 2 created by C61 is the object- 
choice phase, consisting of routine Z1 which 
creates a search criterion by varying one or 
more dimension values of the working hypoth- 
esis, routine Z2 which chooses an object from 
the board, C37 which establishes the test 
conditions for the last routine, IX), which as- 
certains whether or not the object choice 



meets the subject's needs. If it does, Cbl 
continues to Phase 3; if not it returns to Phase 
2 and re-executes it. 

Phase 3 is the experimenter designation 
of the object phase, containing routine Z3 
which presents the object to the experimenter 
for designation and routine C38, a contexter 
that establishes the routine Z4. The procedure 
Z4 processes the information provided by the 
experimenter's designation of the set member- 
ship of the object chosen.' Following the logic 
of the conservative-focusing strategy, 24 flags 
the dimension or the dimension value as rele- 
vant or irrelevant, depending upon whether or 
not the object was designated jves or no. The 
last routine in Phase 3 is routine D1 which 
ascertains whether or not a concept can be 
presented at the current point. Dl checks each 
of the dimensions of the working hypothesis 
and determines whether the subject considers 
them relevant, irrelevant, or untested. If all 
dimensions have been flagged by Z4 as either 
relevant or irrelevant, sufficient information 
is available for the subject to present a con- 
cept to the experimenter. But Dl is also con- 
ditioned if the subject is using less than the 
total number of dimensions and all those he 
is working with have been flagged. If a con- 
cept can be presented, Phase 4 is entered. If 
not, the program returns to Phase 2 and exe- 
cutes Phases 2 and 3 over again. 

Phase 4, which is the final phase, consists 
of procedures Z5, 28, C 22, Z6, and D3. In 
routine Z5 the subject searches the dimension 
values of the working hypothesis for those 
values which are relevant and from the rele- 
vant dimension values creates a concept, i.e., 
a list of dimension values which it believes 
defines the classification rule. The next 
routine is Z8 which presents this concept to 
the experimenter for his designation. Upon 
designation, a contexting routine, C22, is 
executed because Z8 brought in information 
from the external world. C22 is very similar 
to C38 in that it will create a situationally 
dependent routine 26 for utilizing the informa- 
tion provided by the designation of a concept; 

Z6 is only created if the concept is incorrect 
as a subject then has to ascertain what is 
wrong with his prior behavior. 26 primarily 
looks for dimensions which have not been in- 
volved in the concept itself. In other words, 
it looks through the dimension and dimension 
values of the focus object searching for un- 
tested dimensions. If it finds untested dimen- 
sions, it then adds them to the working hypoth- 
esis list. For example, if a subject initially 
only used three out of the five possible dimen- 
sions, Z6 will add one or more dimensions as 
a function of the number of untested dimensions 
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available and the vulue ol the parameter K9 > 
which specifics how many dimensions ate to 
b" <idu«-ti. Ii 7 1> discovers that all tnc dimen- 
sions have been flagged and the subject still 
has not attained the cone, pt, it then assumes 
that he has misflagged a dimension. Instead 
of adding untested dimensions to the working 
hypothesis, it will unmark dimensions on the 
working hypothesis list so that a new search 
criterion will include those which have been 
used in the past. The last routine in Phase 4 
is routine D3 which ascertains whether or not 
the subject should continue to attempt the 
problem. The phase lists created by C61 arc- 
presented in Table 2. 

Upon the completion oi Phase 4, C61 re- 
alizes it has a list of executable routines ior 
all the behaviors from creating a search cri- 
terion to testing the concept; therefore, it 
treats this list as a substrategy, i.e., the 
strategy is complete except for the initiliza- 
tion phase, but because nothing has to be 
reinitialized, this subprogram can be executed 
as if it were a total strategy. Hence, if the 
concept were incorrect, the substrategy would 
be executed until the concept is attained. 

All four phases created and executed by 
C61 from the skeleton strategy list have the 
same general structure. There arc one or more- 
major procedures at the Z level. When informa- 
tion is received from the external world, a 
contexter routine creates a situationolly de- 
pendent routine to determine the meaning of 
the external information. The final routine in 
each phase is a D routine which essentially 
asks whether the subject can proceed or must 
return to the object selection phase to get 
further information. 

In review, G61 proceeds step-by-stop and 
performs the behaviors indicated by the skele- 
ton strategy as being involved in the concept- 
attainment process. It picks its routines from 
long-term memory by comparing the description 
of what needs to be done with the description 
of the capabilities of routines stored away in 
long-term memory. Each phase is created to 
handle logical units of behavior within the 
concept-attainment process, and the phase is 
given to the interpreter for execution. If 
progress can be made, C61 wi. 1 move on to 
create and execute the next phase within the 
problem, and repeat this process until it can 
present a concept. If, upon completion of 
Phase 4, the concept is correct, the program 
is terminated; if incorrect, C61 treats what 
it has already created as a strategy and exe- 
cutes the strategy until a concept has been 
attained. 

The routine following the successful com- 
pletion of a strategy is a postmortem analysis 
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routine called Cl 2. Because the model nas not 
progressed beyond the within-problom analysis 
stag- .this aspect of the process has not re- 
ceived more than cursory attention. At the cur- 
rent time the task of Cl 2 is to tie together the 
total strategy which has been created rather 
piecemeal by C’fcl. It places symbols repre- 
senting Phases 1 , 2, 3, and 4 all in a common 
strategy list and puts links from each of the 
phases to Phase 2. It was intended to have 
Cl2 do an analysis of the execution of the 
program, ascertaining whether there were un- 
necessary behaviors and smoothing out a suc- 
cessful strategy. C12 also stores the success- 
ful strategy on the long-term memory so that it 
can be used by Cl 1 when a subsequent problem 
is attempted. 

The computer program described above at- 
tempts to model the salient features of a subject 
performing a concept-attainment t isk. The 
initial stages arc quite slow because experi- 
menter instructions must be understood, a rough 
idea of how to proceed must be constructed, 
and the subject proceeds stop-by-step. Once 
the full process has been gone thiough the 
pace quickens since the subject repeats be- 
haviors established during the early phases, 
thus eliminating most of the C61 level con- 
toxting previously required. Hopefully what 
has been developed is a reasonable framework 
within which investigations of the concept- 
attainment process can continue-. 



THE STRUCTURAL DETAILS 
OF THE COMPUTER PROGRAM 

Symbolic Representation of Behavior 

In order to present a detailed discussion 
of how the computer program attains concepts, 

*t is necessary to elaborate furthci upon the 
internal structure of the computer program. 
Attention will be given to the representational 
scheme for subroutines, the attribute system, 
and the memory structure. 

Let us examine one process within the 
strategy list, routine P61 which appears in 
procedure ZO. The list of symbols represent- 
ing the routine P61 is given in Table 3. The 
symbol P61 represents a nonexecutable routine 
whose function is to hold the description of 
the executable routine P60. Thus, the P61 
symbol is a pseudocode whose description 
defines the context within which the executable 
routine will function. A given routine may ap- 
pear as the executable routine of several dif- 
ferent pseudocodes. Such a feature permits 
the development of powerful generalized rou- 
tines which are independent of a particular 
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Table 2. Phase Lists to the P-0 Level as Createa by the C61 Context Routine 



/ 1 9-0 


C3« 9-1 


Z(> 9-1 


0 39 Create procedure Z4 


P21 Copy iocus object 


0 0 


P61 Remember name oi focus object 




C31 Put name of focus in memory 


Z4 :t 9-1 


entry point 


P501 Recall object designation 


P62 Remember set membership 


04 1 Pup memory entry point 


0 u 


list 


C21 9-1 


P91 Mark relevancy of 

dimensions 


Cio Create Z7 


P171 Revert dimension values 


0 0 


0 0 


Z7" 9-1 


D1 9-1 


P 1 9 1 Construct working hypothesis 


Q101 Determine whether con- 


P63 Remember name of hypothesis 


cept can be presented 


C31 Put name in memory entry point 


0 0 


P64 Remember how hype theses formed 




0 o 


0*4 9-0 




Z5 9-1 


1 

O' 

Q 


PHI Form a concept 


D40 Determine whether subject 


?67 Remember concept 


should proceed 


C31 Put name of concept in 


0 0 


memory entry point 




P6s Remember how concept 


ffd 9-0 


formed 


Z1 9-1 


0 0 


P131 Select dimensions to vary 




P 14 1 Select now dimension values 


Zb 9-1 


P 1 5 1 Create search criterion 


P72 Transfer concept to 


P64 Remember search criterion 


experimenter 


0 o ! 


j E94 Designate correctness of 




concept presented 


Zl 9-1 


P69 Remember designation of 


P51 Search board for object 


concept 


P65 Remember object 


u 0 


C % 1 Put name of obj ect in memory 




entry point 


C>Z 9-1 


P66 Remember how object found 


C23 Construct procedure Z4 


0 0 


0 0 


C37 9-1 


Z6* 9-1 


C36 Create procedure DO 


041 Acquire untested dimen- 


0 o 


sion 




P 181 Add dimension to working 


DO" 9-1 


hypothesis 


Q50 Determine whether object meets 


Oil Put name of hypothesis 


subject's needs 


in memory entry point 


0 0 


P64 Remember how hypothesis 




formed 


#3 9-1 


0 0 


Z3 9-1 




P71 Transfer object to experimenter 


D3 9-1 


E93 Designate set membership of 


031 Determine whether prob- 


object 


lem completed 


P62 Remember object designation 


0 0 


0 o 





"Routines created at execution time by the preceding context routine. 
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Memory Structure Mechanic* 



Table 3. 


Symbolic Representation of Routine P61 


P61 


9-0 


Pseudocode 




P60 


0 Executable Routine 


9-0 


0 






Al 


Input Attribute 




VI 


0 

M 1 Working Memory 

F3 0 Ml.N Flag 




A2 


Output Attribute 




V2 


0 

M10 Memory Entry Point 

A20 0 Focus Object Attribute 




A3 


Process Description Attribute 




V3 


0 

A305 0 Remembering 



context. The description list 9-0 of the pseudo- 
code P61 contains attribute Ai whose value VI 
is a list of the inputs to P60. The attribute A2 
has on its value list V 2, the names of the lo- 
cations at which the outputs will be placed. 

The attribute A3 has the symbol A305 on its 
value list which describes P60 as a routine 
involving remembering. The descriptions held 
by the pseudocode can be used by higher level 
context routines to ascertain the characteristics 
of the routine. Such a system provides a rudi- 
mentary description of behavior. Whether they 
are contexters, strategies, procedures, or proc- 
esses, all routines are represented in the 
computer program by means of this scheme. 

The special interpreter [ Baker & Martin, 
1965a] extracts the inputs from the description 
list of the pseudocode and places them in the 
IPL-V Communication Cell HO, it then executes 
routine P6t . n IPL-V. The outputs created by 
P60 are left in the location named on the out- 
put list of P61. Except for the memory proc- 
esses, all P and 0 level routines leave their 
outputs in working memory. 

The pseudocode and interpreter system 
permit the development of general purpose 
programs which can be used in a number of 
different situations. For example: Processes 
P61, P62, P63, P64, etc. contain the same 
executable routine P60 and differ only in the 
information contained on their respective 
input-output lists. Thus, P61 may store the 
focus object in short-term memory, whereas 
P62 may remember the experimenter designa- 
tion of an object choice. Such a scheme was 
designed to permit eventual development of 
contexter routines which will place informa- 
tion on the input-output lists of a pseudo- 
code rather than having the human programmer 
code in the information, a step toward programs 
which can create programs. 
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Much of the design of the computer model 
is dependent upon the mephanics of the three- 
level model of memory employed. In the para- 
graphs below the working memory and short- 
term memory are examined in detail. Long-term 
memory was never constructed. 

The working memory consists of only two 
cells — Ml, N and Ml . D — which are on a list 
called Ml . Ml , N contains the name of a par- 
ticular piece of information, for example, the 
name of an object chosen from the external 
world or the name of a search criterion by 
which the subject is scanning for objects hav- 
ing certain characteristics. Ml , D contains 
what we have called an unattached or dummy 
description list (DDL). The dummy description 
list contains a description of the symbol within 
the M1,N portion of the short-term memory, the 
idea being that subject has not attached the 
description to the item itself, but rather he has 
created a description which later routines will 
process and attach either to the element named 
in Ml , N or to some other item of information. 
The rationale is that the dummy description 
list corresponds roughly to a chunk as dis- 
cussed by Miller et al. [i960]. However, this 
chunk will not necessarily be attached to the 
item named in Ml, N. 

The working memory plays two roles within 
the simulation program. In the first role, it 
acts as an input buffer from the external world. 
All information from the experimenter such as 
the focus object or the designation of an ob- 
ject choice or a concept comes to the subject 
through the working memory. For example, in 
the case of the focus object, M1,N would con- 
tain a symbol representing the focus object 
and Ml, D would contain a dummy description 
list which designates this object as being a 
member of the set. The information left in 
working memory is then acquired by a subse- 
quent processing routine and can be stored or 
processed further within the concept-attainment 
processes themselves. The second role of the 
working memory is that of an internal communi- 
cation device between various subroutines 
within the computer program. In the early days 
of the present computer program, it was felt 
that most of the information processed was 
obtained from the external world. However, 
protocol analysis very quickly showed that a 
major portion of the information processed by 
the subject was created internally , therefore 
a requirement existed for some means of tem- 
porarily storing a piece of information so that 
a series of processes could work upon it. 

Most of the low level routines within the 
computer program receive their information 
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from the working memory and, having proc- 
essed it, leave their outputs in working mem- 
ory. In many cases a subsequent routine 
remembers the information in short-term mem- 
ory-. From a programming point of view, the 
working memory-, acting as on internal informa- 
tion buffer, solves many mechanical program- 
ming problems which otherwise would become 
enmeshed in the idiosyncrasies oi ZPL-V itself. 
Working memory is very similar to rhe HO 
Communication Cell of the iPL-tf except that 
it is in the program rather than the program- 
ming language. 

The second major portion cf the memory 
structure is short-term memory which contains 
all of the information relevant to solving a 
particular problem. The current structure of 
this memory is one that can best be described 
as a highly interconnected net. The short-term 
memory structure shown in Figure 1 is designed 
to grow as the information in the problem is 
acquired. However, the growth is constrained 
by a modular memory structure as shown in 
Figure 4. For example, in Figure 3 the symbol 
LI 00 represents the problem which is currently 
being solved. On the description of LI 00 is 
an attribute A102 whose value describes the 



problem by means of the current strategy. 
Describing the current strategy is an attribute 
Alrf whose value list contains the names of 
the search oritera used. Each aOetich rrm-ila 
Iras an attribute Ale whose value list contains 
the objects which have been round, Describing 
eacn object which has boon found is a "from- 
tu lists" containing the dimension that hue 
been varied sn order to fil'd this particular ob- 
ject. The moinoiv structure is, in reality, a 
true; however, the information on one branch 
of the tree is not unique to that branch. For 
example, the iicm-to list on one branch de- 
scribes what dimension was varied to find a 
particular object is also contained on another 
branch of the tree v;hich describes how the 
search criterion was created from the focus 
object. The highly connected net of memory 
was originally conceived of as what ons might 
call a circular memory, in that once it has 
grown over a period oi time there is no real 
beginning and no real end to it because in- 
formation is crosslinked and interlinked so 
heavily that the* structure of the tree has be- 
come obscured. At the present time, because 
of the single problem solution involved, the 
tree does not get overly complex. 
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Fig. 4. Typical Modular Memory Module Used in Short-Term Memory 
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l or clarity, the symbols in Figures 5 a r.c 
•5 u:<- Ii’L-V regional symbols, but in tne actual 
program t:,.sc- symbols art- creates i>y tr.e pro- 
gram -so ti»i- ir.lormaUon is ocqui. ... The mc-m- 
oiy m t givvn m Figure i do s * . :;ist in 
siie-t t-n -nn m- -n.ory prioi to ; .‘lonoi tho 
program. The computer program only possesses 
til*.- capability to create memory as it neons to 
*?tO»v llllo' !•■(* tlO 1 • ■ b UC i i a Hie 11.0 ly CapuOlii ty 
differs considerably fr-om that usually employed 
in computer programming where the programmer 
accounts lor every memory locution used. The 
dynamic memory structure originating hero 
represents a first ste-p toward a computer pro- 
gram which can store and recall information 
without outside intervention. 

Various attributes under which information 
is stored constitute some of the basic assump- 
tions of the current computer program. These 
attributes are felt to be an intermediary step 
between current status and desired status, in 
that the investigators understand neither how 
tc describe behavior nor how people store in- 
formation in memory. Therefore, this is an 
approach to these particularly difficult prob- 
lems. In order for the memory recall processes 
to work, a memory structure was developed 
which enabled the program to toll when it 
reached a point at which information was 
available, hence class and specific attributes 
were devised. In Figure 4 the attribute Adi 
is a class attribute as its function is to hold 
a series of specific descriptions on its value 
list Vdl. The symbols on the body of list V21 
arc dummies whose sole function is to hold 
a description list containing specific informa- 
tion. Thus, the description of list Yd contains 
specific attributes A4 and A5 whose values 
are lists V4 and V5. Such a memory structure 
is symmetrical above and below the dashed 
line, thus permitting a single set of remember 
and recall routines to function at all levels. 

It should be noted that usable information con 
only be obtained from the specific attribute 
level, all higher levels are merely symbols 
representing larger units of information. The 
class attribute value listVdl is also time 
ordered with the most recent data at the top 
of the list. The description lists contained 
to the left of the brackets describe a particu- 
lar list and are themselves of the same modu- 
lar structure. 

The long-term memory has not been de- 
signed because the between-problem variability 
stage of the project has not been reached. 

From the initial protocols and from the current 
computer program, it appears that what is 
stored in long-term memory are strategies 
and key pieces of information necessary to 



execute a particular strategy. It does not ap- 
pear that a great wealth of detailed information 
is ever stored »n long-term memory. Later 
development of the computer program will bo 
devoted to studying the program of long-term 
memory anu trying to realize an adequate model 
tor this aspect of the memory structure. 

The Memory Entry Point 

One of the major problems in developing 
the circular memory structure was some means 
for entering the memory or at least keeping 
track of a present position in the memory' hav- 
ing entered it. The device invented urns called 
the "memory entry point.” If one looks at the 
concept-attainment process, it becomes evident 
that as the subject goes through the various 
phases the information created is normally 
about a particular point within the process. 

Tor example, if an object is chosen from the 
external environment, the subject spends a 
fair amount of time processing various types 
of information about this object — what dimen- 
sion was varied, what the experimenter's 
designation of the object was, etc. Much of 
the information to be stored or recalled is 
related to the particular item. Therefore, the 
object chosen serves as the memory entry point. 
As the process moves on to another piece of 
information, for example, the creation of a 
concept, the memory' entry point changes. How- 
ever, this change is normally either upward or 
downward on the branch of the short-term mem- 
ory so that the memory entry point is really a 
push down, pop up list m which the subject 
keeps track of where he has been in memory. 

The problem of how to initially* enter the mem- 
ory structure has not been resolved, but once 
in the memory structure the computer program 
can keep a record oi where it has been. The 
problem of initial entry was also encountered 
by Quillian in his memory net project; how- 
ever, he chose to avoid it and entered memory 
at arbitrary points by manual means. Because 
several of the context routines have to revert 
to previous levels, there are two small rou- 
tines, C30 and C40, which add names or take 
them away from the memory entry point list. 

The memory entry point technique is not a 
very satisfactory solution; however, at the 
present time it is a ioasiblc one to program 
until a better understanding of memory proc- 
esses is obtained. 

Remembering of information in short-term 
memory and recalling of information from it 
are accomplished by generalized executable 
processes P60 and P50u, respectively. The 
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psi_uc 3 oc<xit.‘ containing P60, say P61 in To bio 
3, has on its input list tho symbol representing 
working memory (Ml) and a flag indicating 
whether Ml.N or M1,D is to be remembered. 
The output list of the pseudocode contains the 
symbol representing the memory entry point 
(M10) and the descriptive attribute (A20) under 
which the information is to be stored. All 
storage operations arc assumed to describe 
the symbol named in the memory entry point, 
and the basic process is unaffected by the 
type of information stored. The distinction 
between storage under a class attribute and 
storage under a specific attribute is handled 
within the basic P60 routine, thus the program 
does not need to concern itself with this dis- 
tinction. The basic recall routine is P500 
which is the converse of P60 and shares much 
of its internal programming. 

The communication of the subject to the 
experimenter is one of the points in the con- 
cept-attainment process of little concern from 
a psychological point of view. Therefore, all 
communications to the experimenter take place 
through a special output register called El 
into which the subject puts information and 
from which tb„* experimenter removes informa- 
tion in order to designate objects or concepts. 
It is mechanically simple, but not necessarily 
psychologically sophisticated. 



THE DETAILS OF THE PHASE 
LISTS TO THE P LEVEL 

Having described some of the underlying 
mechanics, let us turn our attention to the 
details of the phases created by routine C61. 
Some of these phases will be skipped over 
rather lightly, others will be described in 
some detail so that the reader may get the 
"flavor" of the program without excessive 
tedious detail. Table 2 above presented the 
lists representing behaviors to the P level 
which are constructed by C61. Reference to 
this table will aid the reader in following the 
discussions below. 

In the initialization phase, three routines 
are involved, ZO, C21, and D4. ZO remembers 
the focus object and its designation as a mem- 
ber of the set of objects defined by the con- 
cept. C21 creates routine Z7 which establishes 
the initial conditions within the "subject." 

D4 determines whether the subject is to con- 
tinue onto Phase 2. 

The processing of the focus of object 
information by ZO is accomplished by four P 
level routines, P21, P61, C31, and P62. Be- 
cause the subject and the experimenter both 



manipulate objects, it was necessary to design 
the program so that information received from 
the external environment could be separated 
into its external representation and the sub- 
ject's internal representation of the same in- 
formation. Thus, P21 creates a copy of the 
focus object with its dimension values in 
dominant dimension order and also creates a 
dummy description list indicating that the focus 
object is a member of the set defined by the 
unknown classification rule. If this separation 
is not made, descriptive information created by 
the subject becomes attached to the object in 
the external world, an undesirable situation. 

P21 leaves the name of the subject’s represen- 
tation of the focus object in Ml.N and its set 
membership on a DDL in Ml, D. The memory 
process, P61, remembers the focus object under 
an attribute of the problem list and C31 places 
the name of the focus object at the top of the 
memory entry point list. P62 then remembers 
the set membership of die focus object under 
an attribute of the focus object. At the present 
time routine D4 is a dummy routine as the 
decisions subjects make at this point have not 
been ascertained, but it has been inserted to 
keep the phase list structure consistent. 

The procedure Z7 is created by the con- 
texting routine C21; a detailed discussion of 
contexters is given later in the present section. 
In Z7 the first routine is P191, and the inputs 
of this routine are the name of the memory 
entry point and K99 which is an input constant 
specifying how many of the possible dimensions 
are to be worked with throughout this attempt 
at attaining the concept. The function of PI 91 
is to create a working hypothesis fipm the 
focus object remembered by ZO . The working 
hypothesis is created by selecting the first 
K 99 of the m dimensions on the focus object 
and placing them on a separate list, the ra- 
tionale being that some subjects deliberately 
work with less than the total number of dimen- 
sions and other subjects do so inadvertently. 
The working hypothesis is a list in its own 
right; a description of how it was created from 
the focus object, namely the dimensions which 
have been removed in order to obtain the work- 
ing hypothesis, is made into a dummy descrip- 
tion list. PI 91 leaves the name of the working 
hypothesis and the name of the description in 
working memory Ml. Following P191 is a mem- 
ory process routine, P63. P63 remembers the 
name of the working hypothesis under an at- 
tribute of the problem list devoted to the 
working hypothesis. At this point, the program 
needs to remember the description of the work- 
ing hypothesis rather than something about the 
problem, hence P63 is followed by a memory 
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process, C31, which will put the name of the 
working hypothesis into the memory entry point 
list, pushing down the list and saving the 
name of the problem. C31 is then followed by 
a memory process, P64, which remembers how 
the working hypothesis was formed from the 
focus object. Thus, the problem was described 
by the working hypothesis and the working 
hypothesis was described by tow it was cre- 
ated. The rationale underlying this type of 
description is that other routines and context- 
ing operations can utilize the information to 
determine what has happened and then modify 
or create routines to change the behavior, if 
necessary. It should be noted that the con- 
tents of working memory remain unchanged 
during P63, C31, and P64 from the time PI 91 
creates the working hypothesis and the dummy 
description list for describing it; however, the 
memory entry point changes from the focus ob- 
ject to the working hypothesis to make it 
available to the next routine or the next phase. 

The second phase is the object-se lection 
phase which consists of three routines, Zl, 

Z 2, and C32. Routine Zl creates a search 
criterion from the working hypotheses; 22 lo- 
cates an object matching the search criterion; 
and C32 creates the routine DO which deter- 
mines whether the subject can proceed to the 
next phase. The procedure Zl consists of 
four routines; P131, P141, Pi 51, and P64. 

The inputs to P 1 3 1 consist of M10, the memory 
entry point, and a constant, K98, which speci- 
fies the number of dimensions to vary. In the 
normal conservative-focusing strategy K98 
would be one; however, it can be set to any 
number up to the number of dimensions on the 
working hypotheses. Note that K98 < K99. 

M10 contains the name of the working hypoth- 
esis at the top of its list and it is from this 
hypothesis that Pi 31 will select the dimen- 
sions to vary. Because P21 had arranged the 
working hypothesis in dominant dimension 
value order, PI 31 merely needs to select the 
first K98 of these dimensions, thus imple- 
menting the dominance feature in the program; 
i.e., the first dimension value on the list is 
the most dominant and the last is the least 
dominant. Pi 31 creates a copy of the working 
hypothesis and puts the name of this copy 
into working memory on Ml, N. It also cre- 
ates a DDL on which it lists the names of the 
K98 dimensions which are to be varied at this 
point. The DDL is only a partially completed 
list which eventually will become a from -to 
list; i.e., it will name the dimensions, tell 
what their values were originally, and tell 
to what value they were changed. However, 

PI 31 only places the names of the dimensions 



to be worked with on the DDL. The output from 
P131 is left in Ml , N and Ml ,D. Routine Pi 41 
takes the information from Ml a to extracts the 
dummy description list containing the names 
of the dimensions to be varied. It then enters 
the dimension list, Ml 3, which has been stored 
on the problem list LI 00 under the name of the 
external environment, ascertains a given dimen- 
sion, determines what values are available 
other than that of the focus object, and, if 
there are more than two values, selects a 
dimension value on the bast.* of its dominance 
value. The value found is then added on the 
DDL under the "changed to” attribute and the 
value on the focus object is stored under the 
"changed from” value. Upon the completion 
of P141 , the name of a copy of the working 
hypothesis in Ml, N, and the name of the dummy 
description list is in M1,D. PI 51 is the routine 
which varies the dimension values to create a 
search criterion from the working hypothesis. 

It receives the working hypothesis and the DDL 
through Ml and will use the from-to list to 
change the dimension values on the copy of 
the working hypothesis to their new values, 
thus accomplishing the dimension variation. 

If an initial input flag dealing with awareness 
indicates that the subject is aware, the DDL 
is placed in M1,D with the name of the search 
criterion which has been created in Ml, N. It 
should be noted that the working hypothesis 
had not been disturbed because the changing 
of dimension values has occurrec on a copy of 
a working hypothesis known as the search 
criterion which is used to locate objects on 
the board. If the awareness flag indicates 
the subject is not aware, it is then assumed 
that he has inadvertently varied more than one 
dimension, even though he believes he is only 
varying a single dimension. It was very com- 
mon in the protocols for subjects to choose ob- 
jects which varied in more than one dimension 
even though they believed they were searching 
for an object which varied in only one dimen- 
sion. Possibly this is a perception problem; 
however, because perception has been elimi- 
nated, awareness is handled in this somewhat 
mechanical fashion. If the subject is unaware, 
routine Pi 51 will then delete from the dummy 
description list all of the dimensions and their 
values other than the first one. From this 
point on the subject's description of what he 
has done indicates that only one dimension 
has been manipulated even though multiple 
dimensions were actually varied. P151 is 
followed by a memory routine, C32, which will 
place the name of the search criterion on the 
memory entry point list with a push down of 
previous information. C32 is followed by a 
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memory process routine* P64, which describes 
the search criterion with the DDL from the 
working memory. 

The remainder oi the simulation program 
operates in a fashion quite similar to what has 
been described above; as information is cre- 
ated or received from the external world, it is 
initially left in the working memory, and the 
routines which process this information create 
a description and leave it in the working mem- 
ory. Depending upon the information and how 
it is used, it is either left in working memory 
for subsequent routines to pick up and use as 
information or, usually at the end of a series 
of routines, attached to a previous unit of in- 
formation through a memory process and the 
memory entry point list. 

As Phase 3 involves the use of an inter- 
esting contexter, the operation of this particu- 
lar routine within its situation will be described 
in detail. At the time Phase 3 is entered, rou- 
tine Z 2 has located an object meeting the 
search criterion and has stored it in short-term 
memory under an "object found" attribute of 
the search criterion. The name of the object 
found has been stored in the memory entry 
point list, and the object has been described 
by the dimensions of the working hypothesis 
that were varied in order to find it. 1 The first 
routine in Phase 3 is procedure Z3 which con- 
sists of processes P71, E93, and P62. Routine 
P71 is a memory output process which trans- 
fers the subject's name for an object to an 
output buffer called El from which the experi- 
menter will receive the information. Routine 
E93 is an experimenter routine which acquires 
from the El buffer the subject's name for the 
object chosen and compares the dimension 
values of the object with those of the concept 
to ascertain whether or not the object contains 
the dimension values of the underlying classi- 
fication rule. E93 creates a dummy description 
list similar to those previously used which 
will contain a designation attribute and a 
value of .vc s or ho for the set membership of 
the object choice. E93 also returns the sub- 
ject's name for the object to M1,N so that 
the subject may associate the designation 
with the object he has presented to the ex- 
perimenter. Because the memory entry point 
contains the name of the object found, a mem- 
ory process, namely P62, can be used to attach 
the experimenter's designation in working 
memory to the object choice in short-term 
memory. 



^hc reader should refer to Figure 3 to 
trace the levels of short-term memory in- 
volved. 



The experimenter's designation of the ob- 
ject is information from the external world, 
hence it is mandatory that C61 insert a con- 
texting program at this point. Again some cor- 
ners have been cut in that the appropriate 
contexting routine for this situation, C38, has 
been preprogrammed whereas in a more sophis- 
ticated program uic cbl contexter would ana- 
lyze the total situation and create the context- 
ing routine C38. However, this level of sophis- 
tication in the program development has not 
been reached. The contexting routine C38 will 
create the routine Z4 which is the reaction of 
the subject to the experimenter' s designation 
of the object. Initially it creates, a description 
of the characteristics of the required Z4 routines. 
C38 then receives from the input list its own 
location in the Phase list that the interpreter 
is currently executing. Using this information, 

C38 ascertains whether or not the next symbol 
on the phase list has a description matching 
that of the routine Z4 which it wishes to exe- 
cute. If the routine following the C38 contexter 
is a Z4 routine, it will be removed from the 
strategy and its symbol replaced by the sym- 
bol representing the new Z4 which will be 
created. If no Z4 symbol follows C38, as in 
the first time through the phase, a symbol to 
hold a position for the Z4 routine is inserted 
on the phase list. Notice that at this point 
the phase list merely contains a symbol whoso 
description indicates what the behavior should 
try to accomplish; however there is no exe- 
cutable subroutine associated with the particu- 
lar symbol. The phase list is also described 
through the use of the DDL technique to indi- 
cate that a routine has been either inserted or 
replaced on the phase list. The long-term goal 
is for contexters to utilize this change de- 
scription to ascertain what has occurred during 
the execution of the program. The contexter 
C38 uses the memory entry point to obtain the 
name of the object and through a descriptive 
attribute ascertain whether it is a yes object 
ora ho object. If the object was designated 
a ho, C38 determines whether or not the sub- 
ject was aware; if the subject was aware, C38 
checks to see whether the number of dimen- 
sions varied was equal to one or not. If it 
was greater than one, no information has been 
gained; the subject consciously varied more 
than one dimension and received a no so he 
does not know which of the two dimensions 
is the relevant one. In this situation, C38 will 
pop the memory entry point back to the working 
hypothesis so that Phase 2 can be executed 
again. If the subject was aware ^and only one 
dimension was varied, or if the subject was 
unaware, the program returns to the creation 
of Z4. Again, difficulties have been circumvented 
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by merely inserting routines that we know are 
necessary to accomplish the reaction to object 
designation. A routine called P502 is ir erted 
which will recall the object designation. It 
is followed by C41 which pops up the memory 
entry point from the object found to the work- 
ing hypothesis. Popping the memory entry 
point is necessary because Z4 must have both 
the object designation and the working hypoth- 
esis to react to the object designation. The 
next routine inserted is P96 which uses the 
information about the working hypothesis and 
object designation to flag the dimension values 
involved as relevant or irrelevant, depending 
upon the designation. Following P96 is P91 
which looks at all possible values of a dimen- 
sion and checks whether they are marked rele- 
vant or irrelevant. If ail values are marked, 
the dimension itself is then marked as rele- 
vant or irrelevant. However, if any dimension 
value is still untested, P91 will not attempt 
to mark the total dimension. We have found 
that many subjects will not consider a dimen- 
sion to be relevant or irrelevant until they 
have checked all n dimension values. If the 
subject is unaware of the number of dimen- 
sions actually varied, no further processes 
are required in Z4. However, if the subject 
is aware, he then also normally realizes that 
any dimension flagged irrelevant is r.o longer 
of concern in selecting objects and a routine 
called P100, which removes an irrelevant 
dimension from the working hypothesis, is 
inserted after P91. The net effect of PI 00 is 
to enable the subject to choose objects in 
Phase 2 which vary in two, three, or four 
dimensions from the focus object even though 
he is varying only one relevant dimension; 
the remainder no longer enter into any of his 
decisions. One can obtain what looks like 
rather peculiar object choice sequences; 
however, the subject is truly varying only 
one dimension. If routine PI 00 has been in- 
serted, it will be followed by a memory process, 
P64, which remembers the description of dimen- 
sions removed from the working hypothesis so 
that at some later point a routine can put these 
dimensions back in again if necessary. The 
final operation performed by C38 is to put a 
terminal symbol on routine Z4 so that it can 
be properly terminated by the interpreter at 
execution time. At this point a rather tricky 
operation takes place. C3« creates the next 
routine to be executed and places its symbol 
on the strategy list; when C38 terminates, the 
interpreter executes this routine from the strat- 
egy list. 

Phase 3 is terminated by procedure D1 
which determines whether enough information 
is available to present a concept. Dl consists 



of a single decision process routine, Q101, 
which uses the memory entry point to obtain 
the name of the working hypothesis. Each 
dimension of the working hypothesis is checked 
to determine whether it has been flagged rele- 
vant or irrelevant. If all dimensions have been 
flagged, sufficient information is available to 
present a concept. Such a test is rather strin- 
gent as it requires the subject to vary all dimen- 
sions of the working hypothesis prior to forming 
a concept. Experienced human subjects using 
the conservative focusing strategy do vary all 
dimensions, as they know the concept must 
consist of the relevant dimensions. The re- 
sult of Dl is an indication to the interpreter 
to either continue to Phase 4 or to return to 
Phase 2 and vary additional dimensions. Note 
again that a phase terminates in a decision 
routine. 

There is actually little variation in the 
routine Z4 created by the contexter C38 during 
the first pass through the program. However, 
once Phase 4 has placed previously unused 
dimensions on the working hypothesis, the Z4 
routine can vary slightly depending upon the 
decision net through which it passes. C38 
could be made much more extensive in the 
future; however, the rather rudimentary con- 
texting operation used reflects current lack of 
understanding of mechanisms in reaction to an 
object designation. The only other contexter 
of any consequence in the program is C 22 which 
creates process Z6, the reaction to a concept 
designation. C 22 operates in much the same 
fashion as does C38, using factors such as 
the number of dimensions varied, the number 
of untested dimensions, and whether or not the 
subject is aware to create Z6. 

Procedure Z6 is the subject's reaction to 
a concept which has been designated by the 
experimenter as incorrect. The procedure con- 
sists of P level routines Q41, P181, and C31. 

The contexter routine 022 has returned the 
memory entry point to the focus object so that 
041 may inspect it. Q41 uses the dimension 
values of the focus object to ascertain which 
dimensions have not been varied and creates 
a dummy description list containing their names. 
The number of untested dimensions to be used 
is controlled by the parameter K97, which 
specifies how many of the available dimensions 
to use. Pi 81 uses the dummy description list 
created by 041 to restore K97 dimension values 
to the working hypothesis. It partially undoes 
the work done by P191 in procedure 27. If all 
dimensions have been varied and the concept 
was incorrect, Q41 assumes a dimension has 
been misflayged and Plsi makes a copy of the 
focus object for the next working hypothesis. 

C31 places the name of the new working 



hypothesis in the memory entry point. P6-4 re- 
members how the new working hypothesis was 
created. The strategy now returns to the be- 
ginning of Phase 2 and is reexecuted. It should 
be noted that the high level contcxting per- 
formed by C61 is no longer needed as a com- 
plete strategy list is available for execution. 
C61 merely presents this strategy list to the 
interpreter for execution. 

The paragraphs above presented the major 
features of the computer model* To describe 
the lower level programs which the computer 
program actually executes would require a 
sophisticated knowledge of IPL-V and is be- 
yond the scope of the present report. 



SUMMARY OF THE CHAPTER 

The computer model of concept attainment 
embodied in Mark IV, Mod 2 consists of two 
parallel fractionizations of the behaviors in- 
volved in a learning strategy and a memory 
mechanism which facilitates those two as- 
pects of the model. The parallel breakdown 
consists of the contexter routines and opera- 
tional routines. The former represent the higher 
level cognitive processes associated with 
developing strategies, maintaining goal- 
dlrectedness, and improvement of learning. 

The latter represent those aspects of the 
model which actually perform the tasks in- 
volved in attaining the concepts. Routines 
which perform tasks required by the informa- 
tion-processing language rather than behavior 
required to attain a concept have been hidden 
at a lower level within the program. One of 
the difficult tasks in the present project was 
to recognize that operational information 
processing had to be separated from those 
higher level cognitive behaviors associated 
with attaining the goal. The latter have been 
embodied in the computer model as a hierarchy 
of contexting routines. The high level con- 
texters have been designed to translate the 
experimenter's verbal instructions into a 
skeleton strategy for behavior. The second 
level contexters create routines associated 
with initializing a problem and analyzing the 
behaviors in a completed problem, and the 
third level contexters create situationally 
dependent procedures in an attempt to adapt 
behavior to the situation. Although the hier- 
archy of contexting routines is rather rudi- 
mentary at the current time, the distinction 
between operational aspects of learning and 
the contexting aspects of learning is a crucial 
one not previously made. 



Because information, both acquired and 
internally created, plays such a crucial role 
in the concept-attainment process, it was 
necessary to create a model of memory which 
would enable the computer program to both re- 
member and recall this information. The mem- 
ory model created consisted of three levels: 
a working memory, which is an internal buffer- 
type memory; a short-term memory in which 
all of the information relative to attaining a 
given concept has been stored; and a long-term 
memory in which learning strategy and certain 
crucial pieces of information relating to them 
are stored for use in solving subsequent prob- 
lems of . e same or similar types. In the 
present model, the working memory serves 
primarily as a holding or communication device 
for information which is to be passed from one 
behavior to another within a section of the 
computer model. The short-term memory has 
a circular structure so that any given point 
in the memory structure looks as if it were 
the beginning of an information storage tree. 
Several generalized memory processes have 
also been programmed to permit the model to 
remember and recall information within this 
circular memory structure. Although the model 
has not solved the problem of how a human 
enters memory under a given set of circum- 
stances, it does include a memory entry point 
scheme for keeping track of the subject’s lo- 
cation within memory, once memory has been 
entered. The majority of work on the model 
has been devoted to the working memory arvi 
short-term memory; the long-term memory has 
not been modeled. The memory model developed, 
although somewhat rudimentary at the current 
time, has been designed with considerable ex- 
pansion capabilities which provide internal 
flexibility without sacrificing much of the 
capability already acquired. 

The Mark IV, Mod 2 version of the concept- 
attainment model can reproduce a wide range 
of the behavior observed in the think-aloud 
protocols collected from human subjects. The 
range of behavior is accomplished with a rela- 
tively small number of computer routines, some 
of which, such as the memory processes, are 
completely general; others, such as the con— 
texters , are very specific. Unfortunately much 
of the variability is controlled by the three in- 
put constants and the awareness flag; however, 
even this is encDuraging in that so much varia- 
bility can be controlled by so few parameters. 
The long-term goal is to eliminate such para- 
meters and utilize only generalized routines 
to accomplish what Newell [1962] has called 
a "solution by understanding." 
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POST MARK IV. MOD 2 



The completion of the Mark IV, Mod 2 ver- 
sion of the computer model was accompanied 
by a sense of frustration. The structure of the 
contexters was not consistent with the basic 
format followed in the rest of the program, 
hence the computer program needed a consid- 
erable amount of wor*. In addition, numerous 
ways of cleaning up the operational programs 
were apparent. A period of time was devoted 
to studying the program and sketching how 
adjustments could be made, but the changes 
were never programmed as they were not 
deemed worth the effort. It was felt that any 
major programming effort should be made only 
to implement a better conceptualization, not 
to improve the mechanics of an old one. Prior 
to Mark IV, Mod 2 the importance of the higher 
level cognitive processes within the computer 
model was not understood, but the development 
of the contexters emphasized how crucial these 
processes are to a computer model. The im- 
portance of these processes and their imple- 
mentation in the contexters meant that further 
exploration was needed in areas such as how 
persons select behaviors from their repertoire 
of behaviors, how they maintain goal-directed- 
ness during a problem, and how they structure 
their attempts at problem solving. Classical 
psychology does not appear to be interested 
in these problems at a level which would con- 
tribute to a computer model of concept attain- 
ment. Thus, we had reached "state of the art" 
limitations with regard to psychology. The 
final frustration was that the computer pro- 
grammer who had written all of the IPL-V code 
and made major contributions to the total 
project completed his degree program and 
departed. It would take at least 18 months 
to bring another programmer up to his level of 
sophistication with regard to the problem and 
its programming techniques. The net result 
of these frustrations was a considerable let- 
down in enthusiasm for the project. Our data 
were about exhausted: the programming capa- 
bility was diminished; and the "state of the 
art" in psychology seemed to have been 
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reached. After some thought it was decided 
that the last area seemed more worthwhile to 
attack. Perhaps some psychological experi- 
ments could be devised that would yield data 
upon which a better conceptualization of the 
contexters could be based. Therefore, atten- 
tion was directed toward preparing some ex- 
periments involving human subjects. The initial 
experiment was called the planning experiment. 



PLANNING EXPERIMENT 

One issue raised by the development of 
a computer model of the concept-attainment 
task was that of the processes used by a sub- 
ject to create plans or strategies, and the role 
of instructions in forming such plans. What 
was needed was some way of externalizing 
the development of a plan, and the processes 
involved therein, as the subject proceeded to 
solve the task presented him. One way of ac- 
complishing this was thought to be to vary the 
instructions given to the subject, specifically 
with regard to the formation of plans, and to 
note the resulting effects on the subject's 
performance. It was hoped that by providing 
subjects with differential amounts of clues as 
to the formation of a plan, some light might 
be shed on the processes involved. It was 
hypothesized that the more complete the in- 
structions concerning the formation of a plan, 
the better the performance of the subject. 



Methodology 

Subjects. The subjects were 20 female 
University students whose names were ob- 
tained from the Student Employment Service. 

Materials. The subjects were presented 
with a board on which were mounted 36 photo- 
graphs of cartoon animals which were basically 
. similar but varied along four dimensions. 

These dimensions and their values were body 
color (yellow, blue, or brown), neck length 
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(short or long), ear length (short or long), and 
type of tail (straight, bent, or curly). The 36 
animals were randomly arranged on the board 
in rows of six. 

Design. _ A completely randomized design 
employing four treatment levels was employed. 
The treatments consisted of four levels of in- 
struction ranging from the introductory overall 
instructions all subjects were given to a brief 
outline of the conservative focusing strategy. 
The treatments were defined as follows: 

INTRODUCTORY INSTRUCTIONS, ALL SUBJECTS 

What you will be doing in this experiment 
is trying to find out what animals go to- 
gether to form a category that I consider 
correct, in other words, to find out what 
the rule is that describes the category of 
objects that I have in mind. The rule is 
based on some systematic characteristics 
of the animal itself . 

To start off, I will point out one object 
that does belong to the category I have 
in mind. From then on you will attempt 
to discover the rule by choosing one ani- 
mal at a time, and I will tell you whether 
it belongs to the category or not. When- 
ever you think you know what the correct 
rule is, tell me and I will tell you whether 
you are correct or not. 

It is important that you think out loud 
during this experiment so I have a way 
of knowing what you are trying to do. 

treatments administered after first 

PROBLEM 

Treatment I: No further instruction (control 
group). 

Treatment II: "Before you begin the next prob- 
lem, it might be of help to you if you take a 
minute to think about how you will go about 
solving the next problem." 

Treatment III: The instructions of Treatment II 
plus: "... so that you will get the most infor- 
mation from each choice that you make." 

Treatment IV: The instructions of Treatment III 
plus: "One efficient way of doing this is to 

vary only one characteristic of the animal at 
a time from the one that I first give you." 

Treatments II-IV: "Lot me know when you are 
ready to begin again, " 



Procedure. All subjects were run individually. 
The subject was seated before the board anu 
given the introductory instructions, followed by 
the first problem. In brief, the experimenter 
designated one card that did belong to the 
concept and from then on the subject indi- 
cated which of the cards he wanted membership 
information about. Although only the data of 
those subjects who did not appear to be plan- 
ning in the first problem (according to criteria 
that will be detailed below) was to be analyzed, 
all subjects completed the experiment. After 
finishing the first problem, subjects were given 
additional instructions depending on the group 
they had been assigned to (or in the case of 
the control group-— no further instructions) , and 
continued to solve five more problems. All 
subjects received the problems in the same 
older. See Table 4 for the list of concepts and 
the focus card given in each problem. A tape 
recording was made of all the experimental 
sessions, and the experimenter kept a written 
record oi the number of choices the subject 
made as well as the objects chosen. 

A four-item rating scale was devised to 
assess the extent of planning displayed in 
each problem solution. Each item was rated 
on a five— point scale with a rating of 1 re- 
flecting the least planning and a score of "5," 
the most. All subjects who received an average 
score of moderate planning (3.0 or above) on 
the four items were considered as having 
planned on the first problem and were dropped 
from further analysis. See Table 5 for the rating 
scale for extent of planning and Table 6 for 
the scores obtained on the first problem. Of 
the 20 subjects tested, five were considered 
to have planned, four from the Treatment I 
(control) and one from Treatment II. 

Those 15 subjects who received an average 
planning score below "moderate" for the first 
problem had their remaining five problems rated 
on the same planning scale by the experimenter. 
In addition, each of the 15 subjects was rated 
on the development of planning across all six 
problems by way of a four-part scale (Table 7). 
The ratings were made by the experimenter 
from typed scripts of the tape recordings of 
the experimental sessions. 



Results 

The dependent variable was the subjects' 
scores on the instruments dealing with extent 
of planning. To test for differences between 
experimental groups, each individual's plan- 
ning score was found for each problem separately 
by summing his score on each of the four scales, 
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Table 4. Definitions of Concepts Used in Experiment 



Pioblem 


Concept 


I 


Short neck, bent tail 


II 


Yellow, long neck, curly tail 


III 


Brown, short oars 


IV 


Brown, short neck, straight tail 


V 


Short ears 


VI 


Curly tail 



l ocus Card 



Blue, short neck, short oars, bent tail 
Yellow, long neck, short oars, curly tail 
Broun, long neck, short ears, bent tail 
Brown, short nock, short ears, straight tail 
Blue, short no _ ears, curly tail 

Brown, short snort ears, curly tail 



Table 5. Rating Scale Used to Measure Extent of Planning 
1. Extent and consistency of planning 



1 

Little planning, 
low consistency 



3 

Moderate planning, 
moderate consistency 



l. Extent and consistency of ,r Z's n 

1 > 
Few Z's used, inconsistent 
and/or incorrect 



5 

Moderate use of Z‘s, 
moderately consistent 



4 



4 



5 

Much planning . 
high consistency 



5 

Many Z's correctly used, 
consistent 



3. Sufficiency-loops, repetitions, and attention to irrelevant characteristics 



1 

Highly inefficient 


> 


3 

Moderately efficient 


4 


3 

Highly efficient 


4« Number oj object choices 


i 

Many more than necessary 
(over 18) 


2 


3 

About average 
(10-13) 


4 


5 

About as few as 
possible (1-6) 



Table t. Average Extent .of Planning Scores on 
Problem I Using 5 -Point Scale with 
3 Being "Moderate Planning " 





Number of Ss 


Average Planning 
Score 


Excluded 


\ 1 

# * 
1 2 


5 


from 


4 


analysis 


3 




6 


2 




3 


1.5 




6 

N = 20 


1 
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Table 7. Rating Scale to Assess Development of Planning Over Problems 



1. Development of planning over time 

1 1 
Little improvement, 
slow to improve 



3 4 

Moderate improvement, 
moderate speed 



5 

Great improvement or 
planned from the beginning 



l. Development of use of Z’s over time 

i 2 3 

Little improvement. Moderate improvement, 

slow to improve moderate speed 



5 

Great improvement or 
used Z' s from the beginning 



3. Elimination of inefficiency over time 



1 

Little improvement, 
slow to improve 



Moderate improvement, 
moderate speed 



4 



5 

Great improvement or 
efficient from the beginning 



4. Reduction in the number of object choices over time 



Little reduction in Some reduction, 

number, or slow moderate speed 



4 5 

Much reduction or as few 
as possible from the 
beginning 



Table 8. Comparison of the Average Summed Planning Scores 
by Treatment for Each Problem Separately 



Treatment 


i 


2 


3 


4 


5 


6 


II 


6.5 


9.0 


14.5 


15.0 


18.5 


16.5 


in 


6.4 


11.6 


13.8 


15.6 


14.8 


17.2 


IV 


6 


9 


13.2 


14.4 


15.6 


16.8 



Table 9. Comparison of the Average Extent and Development of Planning for Each Scale Separately 



Extent 



Development 



1 

Treatment Planning 



2 

No. of 
Z’s Used 



Efficiency 



4 

No. of 
Choices 3 



Planning 



2 

No. of 
Z's Used 



Efficiency 



4 

No. of 
Choices 



II 

III 

IV 



4 

3.8 

3.2 



3.25 

3.4 

3.2 



3 

3.2 

3 



3.25 

3.4 

3.6 



3.25 

3*2 

3 



3.25 

3.4 

2.6 



3.5 

3.6 
3 



4 

3.8 

4 



deduction in the number of choices. 
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and the group mean computed from summed 
individual scores for each problem. Table 8 
compares the average summed extent of plan- 
ning score for each problem for the tnree groups. 
No data are presented for the control group 
since only one subject did not demonstrate 
planning according. to our criterion. As can 
be seen, the major trend is one of solving the 
problems with progressively more planning, 
but there are no systematic differences be- 
tween experimental treatments. Upon inspec- 
tion of the data, a statistical test did not 
appear warranted. 

It was also possible to compare the ratings 
of extent and development of planning across 
the six problems. In Table 9 the average group 
rating on each of the scales separately is pre- 
sented for the three treatment groups (Treat- 
ment I is again omitted). Once again ng con- 
sistent differences between groups in planning 
over the six problems were found and no statis- 
tical test conducted. 



Discussion 

From inspection of the data, it seemed 
apparent that the major effect obtained was 
one of learning to solve the problem more ef- 
fectively with time, and that treatment differ- 
ences did not play any systematic part. While 
a more methodologically tight study would re- 
quire a larger sample size, and some check 
on the reliability of the ratings made, the re- 
sults of this pilot study did not indicate that 
further effort in this direction would be profit- 
able. 

The lack of results from this experiment 
which was highly structured toward obtaining 
treatment differences caused some concern 
about the earlier decision to pursue this route. 

It appeared that commitment to a long-term 
series of such experiments would result in a 
very low ratio of information yield to man- 
hours invested. Some additional minor in- 
quiries were conducted informally with results 
similar to those just observed. It was also 
realized that a long-term commitment to such 
experiments would require a complete profes- 
sional reorientation of the principal investigator 
from computers to learning theory. Thus, it was 
concluded that the focus of the project should 
return to the computer model. 



A LINGUISTIC APPROACH TO A COMPUTER 
MODEL OF CONCEPT ATTAINMENT 

In one of the earlier progress reports 
written about this project [Baker, 1965) it was 



stated "It is interesting to note that the names 
of the subroutines almost form a verbal descrip- 
tion of the concept attainment strategy, a pos- 
sibility which offers some interesting possi- 
bilities for a string language notation." The 
idee was premature in our thinking and was not 
developed at that time, but the flow chart books 
contained numerous marginal notes relating to 
a verbal representation of the concept attain- 
ment process. The viability of this idea was 
further enhanced by the development of the Cl 1 
contexter routine within Mark IV, Mod 2. The 
function of this routine was to receive coded 
representations of the experimenter's verbal 
instructions and to translate them into a skele- 
ton strategy or plan for attaining the concept. 
The nature of this subroutine and the realiza- 
tion that the contexter routines represented 
higher level cognitive processes led to the 
notion of taking a linguistic approach to die 
computer model. 

Not having a concise idea of what such an 
approach would entail, we decided to reanalyze 
the protocols and the computer program from a 
linguistic frame of reference. The study of the 
protocols revealed that the subjects used a 
very limited vocabulary to describe their own 
information processing. The flow charts of 
Mark IV, Mod 2 also indicated a similar limited 
vocabulary. The presence of a limited vocabu- 
lary and an intuitive feeling that humans repre- 
sent information internally as verbal symbols 
suggested that the scope of the problem was 
within reason. 

The Mark IV, Mod 2 version of the computer 
model was coded in IPL-V and nearly each line 
of the program was annotated to explain what 
the instructions or series of instructions was 
trying to accomplish. Thus, a verbal descrip- 
tion of the total program, line by line, existed. 
The annotations made by a programmer tend to 
be more concerned with the mechanics than 
with the concept; basis of the program. 
Therefore, a narrative which would verbally 
describe the existing computer model was 
written from the program and the flow charts. 

The narrative is included as Appendix C. In- 
spection of the narrative revealed that the 
descriptions of the processes are mainly in 
first person and the sentences are imperative 
in form. A close look at sentences — "Remember 
the focus object," "Find an object on the board 
with a long neck”— showed that they involve 
a single verb accompanied by its object and 
various modifiers. Basically, the verb repre- 
sents an operation to be executed and the rest 
of the sentence represents the context within 
which the operation is to be performed. Such 
a division of functions already existed in our 
computer model and it also seemed to be the 
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natural one for a linguistic approach; i.e., the 
operational level represents a verb and the 
contexter program provides the objects and 
modifiers of the verb. Such a linguistic aP“ 
proach would be extremely powerful in that 
one need only implement a- set of verbs to 
perform certain kinds of operations associated 
with the learning task. The remainder of the 
model would perform a syntactic analysis of 
verbal descriptions of the behavior desired. 

An examination of this approach at the 
lowest level within the computer program will 
show how feasible it seems. For example, 

P131 can be described by the sentence 'Select 
dimension of the working hypothesis." Here 
the verb is select, the object is a dimension 
which is a property of the working hypothesis. 
Thus, one would write a subroutine for the 
verb select and the contexter would provide 
it with the inputs of what is to be selected 
and where it can be found. The mechanics of 
Mark IV, Mod 2 would be of help here in that 
the memory entry print ( MEP) would contain 
the name of the working hypothesis and the 
contexter could specify that it was a dimen- 
sion of the working hypothesis which is to be 
selected. In this example the sentence would 
be received from a higher level routine by the 
low level contexter. This contexter then would 
find the verb, acquire the corresponding sub- 
routine, and use the rest of the sentence to 
establish the entering arguments for the verb 
as symbols on the input list of the subroutine. 
Once the process had been completed, the verb 
routine would be executed and the output 
placed in working memory. 

The key elements of such a scheme al- 
ready exist in Mk IV Mod 2. The interpretive 
scheme described by Baker and Martin [1965] 
enables one to implement the verbs as sub- 
routines with their inputs and outputs being 
situationally dependent. In addition, due to 
the design cf the me .:ory structure, the internal 
communication wchln '.he system is by and 
large automatic regardless of the sequencing 
of the subroutines. The general form of a verb 
under this scheme could be as follows: 



R211 


9-1 


Pseudocode 




R210 


0 verb 


9-0 


0 






A1 


verb modifiers 




VI 






A2 


object 




V 2 






A3 


object modifiers 




V3 


0 


Frxn the 


i above 


it would appear that the 


linguistic approach is feasible at the exe- 



cutable program level at least. For such a 
scheme to be practical from an implementation 
point of view, the vocabulary would have to be 
quite limited and the meanings of the verbs, 
objects, modifiers be very specific; hence, the 
next step was to attempt to write the narrative 
descriptions of the program in a restricted 
vocabulary, yet retain the essentials oi the 
system. Only the operational portion of the 
program was rewritten in this fashion due to 
our greater familiarity with this aspect of the 
program. The condensed form of narrative is 
presented below. 

P190 Create working hypothesis from copy 
of focus object 

4 Enter memory [(MEP)-Ml.N = CFO} 
C190 \Use CFO as WH 

P190 Retain K99 dimension value of WH 



P131 Select dimension to vary 

.Enter memory U MEP}-* Ml ,N = WH] 
Cl 31 .Create description 
'Hold description 

Collect DV of WH not having "rele- 

I vancy" attribute 
Retain K98 DV of collection 
Make DV list the value of "from" 
attribute of description 
Collect value of "dimension" at- 
tribute of elements of DV list 
Make dimension list the value of 
"dimension" attritube of descrip- 
^ tion 



P141 Find new dimension value 

.Enter memory [(MEP) -*M1,N = WH] 
C141 \ Obtain value of "dimension" at- 
* tribute of WH 



P141 



( ( Save value 
Choose DV 

Is DV an element of WH ? 

Yes — choose again 
No — add "from" value to "from" 
list; add "to" value to "to 



list) 

Repeat ( ) 

Make "from" list the value of the 
"from" attribute of the description 
(Make "to" list the value of the "to" 

\ . 1 1 x. ^ 



P151 



Replace "from" DV on WH by "to" DV 



C151 



. Obtain value list of .'from" at- 
\ tribute of description 
1 Obtain value list of "to" attribute 
* of description 



Pi 51 (corn.) 

(Save "from" DV and save "to" 

^ DV 

P151 .Replace "from" DV on WH by "to" 
I DV) 

Repeat ( ) 

P50 Search board 

C50 Enter memory [(MEP) -Ml ,N = WH) 

Search board for object matching 
1 WH 

p 5Q r Hold name of object 

j Obtain value of "how varied" 

f attribute of WH 

'Hold value as description 

050 Verify object chosen 

I Enter memory [(MEP) -Ml.N = 

/ object) 

/ Obtain value of "to" attribute of 
/ object 

1 Enter memory [(MEP) -Ml.N = 

C51 { J° CUS 0b J eCt i 

1 Collect not common element of 

/ FO and object 
1 Hold name of collection 
\ Collect not common elements of 
\ previous collection and "to" list 
v Hold collection 



Q50 



(Is relevancy an attribute of DV, 
l alt: Is DV marked? 

. Yes — O.K. 

j No — Set H5 negative) 

Repeat ( ) 



P70 Present object to experimenter 

c?0 (Enter memory [(MEP) -Ml.N = 

\ object) 

P70 (Transmit name of object to ex- 
t perimenter 

P96 Mark DV 

Obtain value of "designation" 

^ attribute of object 
C96 .Obtain value of "from" attribute 
j of object 

Retain K96 DV of "from" list 

(Save value of "from" list 
^Use experimenter's designation 
P96 ■ of object to determine the "rele- 

# vancy" attribute of DV) 

Repeat ( ) 



P91 Make conclusions on dimensions 

Enter memory [( MEP) -Ml ,N = 
l object) 

C9 j (Obtain value of "designation" 

\ attribute of object 
fObtain value of "dimension" 

' attribute of object 

/(Save dimension 
/Are all but one DV marked? 
j Yes — Set value of the dimension' 

P91 relevancy attribute and concept 
I name 
f No — Exit) 

'Repeat ( ) 

P101 Remove irrelevant DV from WH 

/Enter memory [{ MEP) - Ml ,N = WH) 
/Obtain value of "how varied" at- 
l tribute of WH 

J Obtain value of "dimension" at- 
C101 tribute of description 

j Obtain value of "from" attribute 
f of description 
\ Create description 
'Hold description 

( (Save DV and save dimension 
Is irrelevant the value of the rele- 
vancy attribute of the dimension? 
Alt: Is dimension marked irrele- 

riui . ™ m? 

1 Yes — remove DV from WH 

/ No— go to repeat 
1 Mark DV the value of the "deleted 
\ attribute of the description) 
'Repeat ( ) 

P171 Replace "to” value of WH by "from" value 

Enter memory [(MEP) -Ml, N - WH) 

1 Create description of hold ? 
r .,_ 1 (Obtain value of "to" attribute of 
C 71 \ WH 

fObtain value of "from" attribute 
' ofWH 

/(Replace "to" value of WH by 
( "from" value 

J Make "to" the value of the "from" 
PI 71 . attribute of description 

1 Make "from" the value of the "to" 
attribute of description) 

'Repeat ( ) 

Q101 Can concept be presented? 

C101 Entery memory [{ MEP) - Ml.N = WH) 



0101 (corn.) 



/{Obtain value of "relevancy" at- 
1 tribute of DV 
O101 Was value obtained ?) 

i No — Exit, set H5 negative 

f Yes — Repeat ( ) 



PI 21 1‘orm concept 

Enter memory [( MEP)-*M1 »N - WH] 

( Create descriDtion and concept 
name 

Hold description 

Make WH the value of the "how 

• formed" attribute of the description 



P121 



•Collect elements of WH having 
relevancy attribute to form 
l concept 



Q il Find untested dimensions 



C41 



041 



■Ml ,N = Copy 



{Entry memory [( MEP) 

1 of Focus Object] 

Collect dimension values of CFO 
I not having relevancy attribute 
/ Retain K97 elements of collection 
/ Create description 
1 Make collection the value of the 
I "to" attribute of the description 
\ Collect the values of the next 
/ upper attribute of elements of 
\ collection 

\ Make collection the value of the 
\ "dimension" attribute of descrip - 

' tion 



Q43 Find dimensions marked irrelevant 

Same as Z41 above except that 
it collects elements having 
irrelevant as the value of reie 
vancy attribute 



P181 



Add dimension to WH 



C181 



P181 



Enter memory [(MEP)-*M1,N = CFO] 
[ Obtain value of hypothesis at- 
' tribute of CFO 

^Obtain value of "to" attribute of 
f description 

j(Add element of "to" list to WH) 
iRepeat ( ) 



The initial impression of this condensed 
narrative is that it is primarily concerned with 
internal data processing. A large proportion 
of the statements deal with the mechanics of 
organizing information from memory , holding 
the information for subsequent use, and making 



decisions based upon characteristics of this 
information. Again, this is in keeping with the 
earlier observation that most of the information 
processed is created internally during the prob- 
lem solutions. Part of the problem rests with 
the design of the P and Q level routines which, 
in general, encompass too large a segment of 
behavior. The result is that the execution of 
behavior requires too many interrelated steps. 

The condensed narrative does provide a reason- 
able fractionation of these behaviors into smaller 
units. In many cases these smaller units are 
actually subroutines in the present program, 
although they were not structured with a lin- 
guistic approach in mind. From this condensed 
version, it was possible to compile a list of 
the verbs employed and their objects, modifiers, 
etc. As initially compiled, the list of verbs 
contained considerable redundancy and overlap 
of function, but after some effort the following 
verbs were defined: 

Verb Definition Equivalent 

IPL-V 

Primitive 



Remember Ml ,N or Ml ,D becomes value Jll 

of attribute of the contents 

of the Memory Entry Point 
(MEP) 

Recall The value of attribute of J10 

the contents of the MEP is 
placed in working memory 



Enter 



Use 



Collect 



Remove 

Create 



The contents of tire memory 
entry point is placed in work- 
ing memory 

An undescribed copy of a list J73 
is created and given a name 
which is left in working mem- 
ory 

(a) Elements of iistX having 
(not having) Y as value of at- 
tribute Z are placed on a list 
whose name is left in work- 
ing memory 

(b) Elements not common to 
lists A and B are placed on 
a list whose name is loft in 
working memory 

(c) The values of attributc__ 

of the symbols on list are 

placed on a list whose name 
is left in working memory 

Delete symbol from list J69 

Make a symbol for a name J90 

or a dummy description list 
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Verb Definition Equivalent 

IPL-V 

Primitive 



Describe 


Make Y the value of at- 
tribute Z of X 


JU 


Retain 


Keep only the first K ele- 
ments of list X 


J75 


Obtain 


Get the value of attribute 
Z of list X 




Select 


Randomly pick a dimension 
or dimension value 


J16 


Add 


Insert symbol on list 


J65 


Repeat 


A section of the program is 
reexecuted 




Replace 


Element _ is removed and 

clement is put in its 

place 


J67 


Search 


The external environment is 
inspected for an object match- 
ing the search criterion. Name 
of the object found is left in 
M1,N 




Transmit 


Move symbol A to location B 




Property 


Decision Routine Equivalent 

IPL-V 


Belong 


Is an element of list 

> 

% 


j 62 


Equal 


Is symbol the same sym- 
bol as ? 




Found 


Was obtained 




Charac- 

teristic 


Is value of attribute 

of list equal to ? 





The utter dependence of the computer model 
upon the underlying structure of the language 
in which it has been programmed is quite clear 
in the list of verbs. It should be noted that 
the working memory is our analogue to the HO 
communication cell of IPL-V, but IPL-V has no 
analogue to the memory entry point. Nearly 
all verbs have corresponding IPL-V primitives 
which perform nearly the same function. This 
illustrates the fact that when programming in 
IPL-V one has difficulty developing higher 
level programs which do not reflect its char- 
acteristics. The natural question is why not 
write directly in IPL-V and forget Z's, P's, 

0's, and the contexters. There are three major 
reasons why one should not do so. First, there 
is considerable hope of establishing a circular 



memory structure in which information can be 
stored and retrieved by the computer model 
rather than by the computer programmer. Sec- 
ond, the interpretive scheme, in conjunction 
with the contexters, allows the computer model 
to create program sequences and modify them. 
Third, most if not all of the messy housekeeping 
details of the IPL— V larguago are buried deep 
within the subroutines and are never a consid- 
eration within the computer model. If such 
details are not hidden, the major portion of the 
model becomes enmeshed with mechanics of 
housekeeping. Thus, what has been developed 
in Nferk IV, Mod Z is essentially a higher level 
set of IPL-V primitives which permits symbol 
manipulation without concern for the mechanics 
of memory management or housekeeping details 
inherent in the language. If one does not get 
the model above these details, it becomes im- 
possible to develop contexters and other rou- 
tines which can create program sequences 
which are arbitrarily ordered. Without such 
a higher level symbol manipulating capability, 
the linguistic approach would be exceedingly 
difficult to implement. In addition, it would 
seem, to this author at least, that the current 
approach could lead to a computer modeling 
language in which a verbal description is given 
of what is to be done and the underlying IPL-V 
is compiled. The existence of many verbs in 
subroutine form in Mark IV, Mod l and the Baiter- 
Martin interpretative scheme suggest that thii 
aspect of a linguistic approach is possible. 

Although the operational verbs can be im- 
plemented, they are only a small portion of the 
linguistic approach. The major portion of such 
a model must deal not with the translation of 
the experimenter's verbal instructions, but with 
their elaboration into numerous subbehaviors. 

This elaboration procedure is performed covertly 
by the subject and is exceedingly difficult to 
study. To illustrate the nature of those elabora- 
tions, let us examine the following sentence in 
the experimenter's instructions: "You are to 
choose an object from the board." The sentence 
tells the subject what to do but does not specify 
how. The subject must elaborate this sentence 
into a complex sequence of behaviors. The 
sequence is roughly as follows: A basis for 
choosing an object must be established; a pro- 
cedure for comparing this basis with the object 
must be developed; and certain of the resulting 
information must be remembered. These sen- 
tences must be elaborated even further. For 
example, the basis of the object choice in- 
volves combinations of dimensions and their 
dimension values, the number of dimensions 
to vary at once, and rules for deciding whether 
the object agrees with the criterion. All of 



O 

ERIC 



40 



31 



these internally created considerations must 
be organized into purposeful behavior and re- 
tained for execution. The nature of this elab- 
oration process is not entirely clear and how' 
one would develop the mechanics for its im- 
plementation is obscure. 

The General Problem Solver [Newell, Shaw, 

L Simon, 19SH) has solved the elaboration 
problem within a special framework, and per- 
haps the approach could be adapted to the 
present problem. The GPS program determines 
the discrepancy between the present state and 
the desired state. It then attempts to reduce 
this discrepancy into smaller units, each of 
which are handled in the same way. Eventually 
resolution of a small discrepancy permits higher 
level discrepancies to be handled. In the pres- 
ent situation the experimenter’s instructions 
could be the present state and the verb, with 
its requirements, be the desired state. The 
elaborations could consist of trying to meet 
the verb's requirements. Let us use the verb 
choose to illustrate how this might be done. 

A prototype of the verb choose could be stored 
in long-term memory and its description would 
contain a specification of the kinds of informa- 
tion necessary to execute the verb — the object 
of choose, the basis for the choice, the en- 
vironment from which the choice is to be made, 
and that the chosen object is to be remembered. 
The contexter would then use the experimenter’s 
message to meet as many of the verb's require- 
ments as possible. It could specify what is to 
be chosen and the environment it is chosen 
from. The rales of the programming system 
dictate that the object chosen be given an in- 
ternal name which is left in M1,N of the work- 
ing memory. Thus, the only discrepancy at 
this point is the basis for choosing the object. 
Several possibilities exist. First, one could 
look for the word basis in long-term memory 
and attempt to fulfill its requirements in a 
similar fashion. Second, one could invoke 
the conservative focusing strategy which 
formulates that object to be chosen by varying 
one dimension per object choice. The latter 
is easier to implement, but the former is prob- 
ably the proper approach although basis would 
need to be properly defined as it could have 



several different meanings depending upon the 
context. If such an elaboration process were 
successful, the end product would bo the sym- 
bol for the verb choose with its description 
list containing the symbols necessary to exe- 
cute the verb in its present context. Thus, at 
the IPL-V code level choose would mean to 
compare symbols on one list with symbols on 
another list. If they match, the object is 
chosen; if not, a new list is obtained and the 
process repeated. 

Another problem intrinsic to a linguistic 
approach is that of automating when information 
is to be remembered and when it is to be re- 
called. At the present time simulation programs 
remember everything or the computer programmer 
has built in his intelligence to define when 
memory processes are to be performed. The 
heuristics underlying automatic memory proc- 
esses are completely beyond the author of the 
present report and perhaps beyond toe state of 
knowledge at the present time. 

Because of the difficulties associated with 
elaboration and self-initiating memory processes, 
it does not appear feasible at the present time 
to attempt to develop a full-blown linguistic 
model. A much more feasible approach would 
seem to be one in which the condensed narra- 
tive presented above is structured in linguistic 
form so that every statement involves a verb. 

The complete concept-attainment task could 
then be written out as in the condensed narra- 
tive. Low level contexter s could be written 
which analyze these short sentences and estab- 
lish the requirements of each verb. Then each 
verb would be executed. The higher level con— 
texters would be used to effect the elaboration 
from the experimenter's instruction to the known 
lower level verbal statements contained in the 
condensed narrative. Such an approach could 
enable one to develop low level contexters to 
handle the verbs and high level contexters 
which would provide some insight into the 
elaboration process. Attacking the linguistic 
model from this angle would seem to offer the 
greatest possibility for a better understanding 
of the concept-attainment process. But be- 
cause this is a final report for this project, 
others will have to implement these ideas. 
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IV 

SUMMARY AND CONCLUSIONS 



The model has been developed to its cur- 
rent state through a combination of protocol 
analysis, computer program analysis, and hours 
of spirited debate. A comparison of the first 
concept-attainment program with the current 
version reveals many differences — some ob- 
vious, some subtle, but, hopefully, all in the 
direction of increased understanding of the 
concept-attainment pr>cess. As was indicated 
in the introduction, the concept-attainment 
task was chosen because it appeared to be a 
simple task and easy to program. There was 
little realization that it would lead to a hier- 
archy of contexting routines, a model of mem- 
ory, pseudocode schemes, and many other 
facets of the present model. Each problem 
encountered and the solution devised for it 
merely served to expose previously hidden 
considerations which were more difficult and 
more important than the problems previously 
encountered. Thus, the deeper the project has 
delved into concept attainment, the more com- 
plex the psychological processes have become. 
The original estimation of the simplicity of the 
task has changed to respectful awe at the po- 
tential complexity of even the most rudimentary 
cognitive behavior. Such a new frame of refer- 
ence has strongly reinforced the author's con- 
viction that computer modeling provides a power- 
ful tool for investigating cognitive behavior. 

In the preliminary report of this project 
[Baker 1965b[ each of the various versions of 
the program was explained in seme detail. In 
this chapter the important features of the sev- 
eral programs are summarized. The rest of the 
chapter has been devoted to discussing the 
salient aspects of what the principal investi- 
gator feels was learned from his experiences 
in computer modeling of the concept-attain- 
ment process. 



A SUf'WARY OF THE CHARACTERISTICS OF 
THE VARIOUS VERSIONS OF THE MODEL 

During the course of development of the 
various concept-attainment programs, a num- 



ber of major themes developed, some of which 
occurred rather early in the project, others only 
after the investigator had considerable experi- 
ence in attempting to model the concept-attain- 
ment process. The original computer program, 
Mark I, was based upon a rather intuitive idea 
as to how the author would solve the concept- 
attainment problem. In attempting to write an 
IPL-V program for the concept-attainment task, 
it was necessary to introduce things such as 
random number generators to create hypotheses 
ami record keeping systems for determining 
which possible combinations of dimension 
values had been used. The program reflected 
neither a clear-cut underlying strategy nor any 
clear-cut understanding of the underlying 
mechanisms. Mark I was just an attempt to 
see whether a program could be written to at- 
tain a concept. In addition, an attempt was 
made to provide the program with a certain 
amount of variability in its object choice be- 
havior through the use of various constants, 
length of lists, and mechanisms of this general 
type. At the time the first program was written, 
such was the basic approach underlying many 
of the published programs for various cognitive 
behaviors. 

A number of lessons were learned from pro- 
gramming Mark I version of the program and 
most of these were associated with program- 
ming in the IPL-V language. Although extensive 
sub routining is standard practice in scientific 
programming, it is somewhat easier to accom- 
plish in that setting because programmers have 
experience with fractionating problems and 
recognizing reasonable subroutines. Such was 
not the case for the author in IPL-V as the 
procedures and processes involved were rela- 
te iy new and how to fractionate the problem 
was not readily apparent. The original program 
tended to be one straight-line program with 
little subroutining. However, from the program 
it was obvious that greater care is needed in 
subroutining in simulation programs than in 
scientific programs and much of the later ef- 
fort of the project was devoted to a continual 
fractionization process in order to break down 
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the cognitive behavior into smaller modules. 
Although Mark I was not very sophisticated, 
it clearly demonstrated the feasibility of tbit 
type of programming to the present author and 
suggested that a longer term project would be 
feasible. 

The learning strategies suggested by 
Bruner et al. [1956) have served as a focal 
idea within the concept-attainment project, 
and the concept of a strategy list appeared 
very early in the development of the system. 
Although such a strategy list was not vsed in 
the original version, the strategy list and a 
symbolic representation of procedures, proc- 
esses , and information processing modules 
were developed in the flow charting books 
worked out during the summer of 1964. The 
only features of the strategy list idea that 
have changed very much over a period of time 
are some of the mechanical aspects, such as 
how many links follow a decision point. A 
number of different schemes were proposed to 
implement the actual execution of the strategy 
lists, and eventually an interpreter program 
was developed by Mr. Martin. The interpreter 
is an extremely sophisticated IPL-V program. 

The interpreter developed in late 1964 to exe- 
cute the strategy list remained unchanged 
through Mark IV, Mod 0. When the high level 
contexting operations were introduced in 
Mark IV, Mod 1, it became necessary to make 
minor modifications in the interpreter to iden- 
tify when a contexting routine had been entered. 

One can observe in the descriptions of 
the various Marks and Mods of the program a 
rather subtle change in the nature of the rou- 
tines at the Z and P level. In the early days 
the Z‘s ami P's corresponded to rather large 
segments of the concept— attainment process, 
and it was necessary to continually redefine 
each of these symbols. Although the symbols 
Zl, Z2, 23, etc. have been used since the 
earliest days, the routines these symbols 
represent have changed very radically. There 
have been essentially three major restructur- 
ings of the strategy lists and hence of the 
program itself. The first of these occurred at 
Mark III, Mod 1 [Baker, 1965c] after it was 
discovered that the several memory process 
routines were nearly identical except for the 
inputs. A major effort was then made to find 
communalities throughout the program and 
utilize the same processes in several differ- 
ent situations. The second major restructur- 
ing of the program occurred with Mark IV, 

Mod 0 when the circular memory structure 
was introduced. All of the memory processing 
routines, and a number of other routines, were 
redesigned to take into account the incorpora- 



tion of the circular memory structure and the 
memory entry point in the program. The third 
mejur restructuring of the program occurred in 
Mark IV, Mod 2 where the contexting routines 
were introduced at three levels. The first 
level contexting routines, CIO and C61, cre- 
ated tne strategy. Both the second level con- 
texter, C22, and the third level contoxtors, 

Ci7 and C33, created Z level routines which 
were situationally dependent. 

The fractionization process is by no means 
complete. It can be seen quite readily in Mark 
IV, Mod 2 that the working-memory processes 
need to be restructured again and some sub- 
routines developed which will handle the trans- 
fer of information to and from working memory. 
Such routines have been designed but have not 
been programmed. The P's and Q's in the cur- 
rent version are still too large, and the amount 
of information processing they do is too exten- 
sive. A further fractionization of these routines 
depends upon more information about human 
cognitive behavior than is currently either 
available in the psychological literature or 
observable in the protocols. 

One of the basic tenets of the program de- 
velopment was that of the "backwards'' approach, 
starting from a program for a very experienced 
subject and working backwards to a subject 
who is less experienced in solving concept- 
attainment problems. Through Mark III, Mod 1 
the computer model was strictly that of an 
experienced subject. In Mark III, Mod 2 it 
was discovered that with relatively little ef- 
fort it was possible to create nearly all the 
basic types of variability required by the sev- 
eral types of Bruner strategies and observed 
within the protocols by assembling the various 
P's and Q's into new types of Z's. Variations 
within the conservative-focusing strategy have 
been introduced principally through the means 
of the constants K96, K97, and K98, although 
in the Mark III, Mod 2 version they were handled 
somewhat clumsily. In the Mark I V, Mod 2 
version the three constants will elicit all of 
the variability, other than the wholist strategy, 
previously observed in Mark III, Mod 2. In 
Mark IV, Mod 1, the awareness factor was also 
introduced, which was related to the psycho- 
logical dependence of the dimensions in 
Bruner-type materials. A considerable amount 
of variability can be constructed through the 
use of the awareness factor. Its psychological 
origins are considerably deeper, but the para- 
meter is a reminder to look at this type of 
behavior. At the current time, the within- 
problem variability exhibited by the computer 
program is quite satisfactory , but it is un- 
fortunate that such variability results from 
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the "screwdriver" parameters — K96, K97, K98, 
and the awareness factor. The ultimate goal 
is to have the within-problem variability re- 
sult from the "subject's" own mechanisms. 
Eventually, the within-problem variability will 
occur at die contexting level where, through 
misanalysis or other mechanisms, the program 
will create its own variability. Such a capa- 
bility is presently provided by having those 
of us on the outside of the program code it in 
through the screwdriver parameters. Internal 
creation of variability in behavior is not a 
trivial problem and has been investigated by 
many other people. To solve it would mean 
accomplishing Newell's [1962] "solution by 
understanding"; this does not appear to be 
on the immediate horizon. 

In retrospect, it appears that the major 
portion of our programming effort was devoted 
to memory structure. It was realized in the 
summer of 1964 that much of the success of 
the concept-attainment model would depend 
upon how adequately memory structures were 
modeled. In the original version of the pro- 
gram no attempt was made to model memory. 
Information was merely stored in IPL-V lists 
and data terms , and the computer programs 
were written to extract information from stor- 
age when necessary. The first version of the 
program in which any serious attempt was 
made at building a memory model was Mark III, 
Mod 0 in which the three-level breakdown of 
working memory, short-term memory and long- 
term memory was utilized. The two cell idea 
of the name and description within working 
memory was also invented. The mechanics 
were quite rudimentary and the idea of a 
dummy description list, although mentioned, 
was not fully developed. The Mark. Ill version 
of the program also introduced the modular 
memory structure. The problem arose of deter- 
mining when the program had reached a level 
at which information was available, and the 
nonbodied lists containing specific attributes 
were invoked in order to terminate the search- 
ing procedures. The Mark III version had a 
confused scheme for extracting information; 
some P’s would use a memory process to ac- 
quire information whereas other P's would 
directly use the name of a list and obtain the 
information. The confusion reflects our un- 
certainty about the structure of memory. 

In the Mark III version of the program, it 
became quite clear that most of the informa- 
tion dealt with by the Program was descri -tions 
of other information. The modular memory 
structure was designed to implement storage 
of descriptions rather than storage of specific 
items on lists. Although a rather highly inter- 



linked memory net was inadvertently developed, 
it was not until a series of discussions were 
held with Dr. Ross Quillian at Systems Develop- 
ment Corporation that the possibility of com- 
pletely interlinking the memory net was realized. 
With this concept in mind, the memory structure 
of the program was completely redesigned in 
the Mark IV, Mod 0 version where the circular 
memory structure and the memory entry point 
were introduced. Although the circular memory 
structure was new, the modular structure utilized 
in Mark III was retained as the mechanisms 
were well understood and seemed to be func- 
tioning fairly well. The problem of how the 
computer program could store and recall informa- 
tion under its own control is still unsolved and 
is one of the major unsolved problems of model- 
ing cognitive behavior. 

The subject's control of his own behavior, 
i.e., contexters, had its origins in the very 
early days of the project, all of the flow chart- 
ing books carry marginal notes which record 
various ideas about contexting . The original 
contexters were conceived of as low-level 
programs which would establish the input list 
under A1 and output list under A 2 for each of 
the P routines, but the low-level contexters 
were never programmed due to structural dif- 
ficulties in Mark III. After development of the 
circular memory structure In Mark IV, Mod 0, 
it became obvious that representation of the 
total concept-attainment process was neces- 
sary, and a rudimentary model of the total 
contexting Process from the experimenter's 
instructions to the actual execution of the pro- 
gram was made. Again the low-level contexters 
escaped our attention, and computer programs 
to set up the inputs to the various P's have not 
been written in that an adequate description 
of behavior is not available. The attribute sys- 
tem used in the experimenter messages to 
describe gross behavior and also to describe 
the procedures on the strategy list is a tem- 
porary device to be used until a better insight 
is gained. Newell's article 1 196^] on the inter- 
nal organization of computer programs provides 
several examples of his attempts to resolve 
this problem within the General Problem Solving 
program. A system for describing behavior 
which a computer model can handle alone is 
an extremely difficult task and so far has 
eluded investigators involved in computer 
modeling of cognitive behavior. The final out- 
come from the study of the contexter was the 
idea for a linguistic model of the concept- 
attainment process. It appears to be reason- 
able to employ the mechanics of Mark IV, 

Mod 1 in conjunction with a rudimentary syn- 
tactical analysis capability to construct a 



contexter hierarchy which deals solely with 
an English language representation of be- 
havior. 

MODELING CONSIDERATIONS 
Internal vs. External Information 

In the early days of the project, the con- 
cept-attainment process was thought to be 
primarily one of processing information re- 
ceived from the external world. However, 
after the computer program had been developed 
to the current point, it became apparent that 
the majority of the information processed does 
not come from the external world but is cre- 
ated internally by the subject. Thus, although 
concept attainment is an information-process- 
ing problem, the amount of external information 
processed minimal and consists only of the 
objects, the experimenter's instructions, and 
his designation of object choices or of con- 
cepts. It should be noted that perception 
problems associated with observing dimen- 
sions and their values were intentionally 
omitted, but this is typical of most existing 
computer models. As the majority of informa- 
tior. is created internally, it is the task of 
psychologists to determine what internal in- 
formation is created and how it is processed. 
For example, from a protocol it is quite easy 
to determine that when an object is designated 
as a yes or a no the subject creates informa- 
tion about the relevancy or irrelevancy of a 
particular dimension or dimension value, but 
on what basis he does is not clear. If one is 
to develop an adequate computer model, one 
must know what information is created, on 
what basis a subject created the information, 
what he did with it, and how much of it was 
retained for longer term use. Without sub- 
stantial knowledge of this type it becomes 
difficult to develop sophisticated computer 
models. Unfortunately the current techniques 
of psychological experimentation do not seem 
capable of providing the requisite insight. 



The Memory Model 

Analysis of the concept-attainment task 
indicated that any significant modeling of the 
concept-attainment process was impossible 
without some model of the structure of memory 
and of the cognitive processes associated 
with remembering and recalling. The three- 
level structural model of memory developed 
for the present simulation program appears to 



be a reasonable model. The idea of the work- 
ing memory functioning as a temporary holding - 
type memory has proved to be an exceptionally 
useful concept as it enables information to be 
communicated from routine to routine without 
going through the rather complex mechanisms 
associated with short-term memory. 

Conversations with Dr. Ross Quillian 
elicited the observation that the memory struc- 
tures in the earlier editions of .the concept- 
attainment program were very rearly memory' 
nets. Later, the memory structure was rede- 
signed to the present circular memory structure. 
The use of a list structure format for memory 
has seemed excessively artificial to the pres- 
ent author and the circular memory structure 
appears to provide a reasonable alternative. 

The significant feature of the circular memory 
structure is that, although the memory proc- 
esses in the model can store and recall infor- 
mation, the memory does not consist of a series 
of predefined bins into which information is 
automatically placed. The memory structure 
is dynamic in that storage is created in the 
proper structure as the information is created, 
rather than knowing ahead of time that certain 
pieces of information are to be stored in given 
registers. The dynamic nature of the circular 
memory structure also gave rise to the prob- 
lems of entering the memory structure and 
Keeping track of where one is in memory. Be- 
cause the order in which memory is created 
is situationally dependent, the memory entry 
point (MEP) has proven to be quite successful 
in performing the bookkeeping associated with 
the circular memory structure. The problem 
which is as yet unresolved is a mechanism for 
entering an existing memory structure, such 
as would be required when a second or subse- 
quent concept-attainment problem was begun. 

The memory model employed is somewhat 
clumsy mechanically; however, its structure 
does provide for the eventual inclusion of both 
interference and decay-type forgetting. The 
inclusion of forgetting in the computer model 
would again raise many more problems than 
it would solve but should prove to be of in- 
terest. 



Attribute Structure 

The Mark IV, Mod 2 computer model in- 
volves approximately Z5 attributes under which 
various types of information can be stored. 
These attributes were divided into class at- 
tributes and specific attributes, and-ccrtain 
mechanics were invented in order for' the com- 
puter program to ascertain what information 



was available under these attributes. For ex- 
ample, under a class attribute chunks of in- 
formation are available; under a specific 
attribute, unique items of information exist 
which can be extracted. The attributes em- 
ployed were a function of the particular ex- 
perimental situation modeled and represent 
an initial approach co the exceedingly difficult 
task, of describing behavior. The next logical 
step appears to involve creating both class 
and specific attributes from a minimal set of 
basic descriptive attributes, but the logical 
basis for defining such a basic set of attri- 
butes is not presently obvious to the author. 
Given such a basic situation, it does appear 
to be quite possible for the computer program 
to create both class and specific attributes 
when required by the situation. Thus, the 
computer model could handle the descriptive 
processes using its own capabilities. The 
attributes currently used were devised by the 
computer programmer and as such merely iden- 
tify or label different units of information 
which he believed necessary. However, to 
shift this responsibility from the programmer 
to the computer program is a major step which 
clearly needs to be taken. 



Use of Protocols 

The think-aloud protocols, especially 
those with experimenter interrogation of the 
subject, have been an excellent device for 
eliciting the grosser behaviors exhibited by 
subjects within a concept-attainment task. 

The think-aloud protocols have been extremely 
disappointing in providing answers to the 
more fundamental questions which now need 
to be' answered. It seems that the "state of 
the art" limitation in protocol analysis was 
reached, and it is difficult to elicit much more 
information from the protocols than has been 
extracted . The failure of the protocols to 
provide answers to questions about the in- 
ternal mechanisms of human subjects, such 
as contexting and memory, suggests that new 
techniques of psychological inquiry are des- 
perately needed in order to study covert be- 
havior. 



Contexters 

During the early phases of the present 
modeling project, the computer model con- 
sisted essentially of the strategy list with 
its Z routines, P iou tines, and Q routines. 
Upon more detailed fractionization of the 



computer program itself, it became increasingly 
apparent that the central executive function 
had to be separated from the operational func- 
tion. There are actually two parallel processes 
which occur as a human being solves a problem. 
One was designated the contexting process 
which is tho monitoring, supervising, goal- 
directing aspects of human behavior, i.e., the 
higher level, cognitive processes. The second 
is the operational aspects involving what one 
might call the subject's abilities, habits, or 
mecnanisms. Once the difference between the 
contexting program and the operational program 
was conceptualized, a major restructuring of 
the computer program was possible and made 
for significant differences in the model of cog- 
nitive behavior. 

A contexter can be viewed as creating a 
plan or strategy for behavior. At high levels 
in the model it creates plans for overall be- 
havior and at low levels it creates plans for 
very specific actions. Such planning hierarchy 
was first envisioned by Miller, Galanter, and 
Pribram [ I960 j when they suggested the exist- 
ence of plans which create plans. Their scheme 
and the present hierarchy of contexters have 
two implications for the internal organization 
of a computer model. First, the program must 
be organized so that it can treat itself as data; 
second, a contexter must be able to create pro- 
grams from the "abmties," i.e. subroutines, 
possessed by the "subject." In the first case, 
the contexter routines must be able to analyze, 
modify, and otherwise manipulate the computer 
program itself. Without such abilities, the 
contexters cannot improve the subject's per- 
formance as a function of experience. The 
mechanics of treating the total program, in- 
cluding the contexters, as data ran be accom- 
plished through interpreter schemes such as 
that programmed by Baker and Martin [1965] 
in which the strategy or plan is a list of sym- 
bols representing behaviors. However, the 
symbols are executed by means of an inter- 
preter rather than directly in the underlying 
language. Because these symbols are placed 
on lists, they can be treated, through the list 
processing language, as if they were data and 
can be manipulated by the contexter routines. 
Such a requirement rules out compiler-type 
list processing languages which are not cap- 
able of modifying the source language at 
execution time of the object program. Thus, 
it would appear that more sophisticated inter- 
preter-type languages such as IPL-V will need 
to be developed. It should be pointed out that 
the Baker-Martin scheme divorces tho con- 
texting operations from the interpreter as the 
contexters are also executed by the interpreter. 
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The lack of differentiation between data 
and program means that both must share a 
common internal representation ano that the 
internal organization of the computer program 
must facilitate both the storage and retrieval 
of information in some uniform fashion- In 
most existing computer models, the memory 
processes have been avoided by having the 
computer programmer remember where he 
stored the information and recall it for the 
program via tho code he writes. Under on 
adequate computer model, the program should 
decide what should be stored and store it so 
that the program can retrieve it through its 
own recall mechanisms when the information 
is required. Uniformity of storage ano retrieval 
in the present model has been implemented 
through the use of a modular memory structure 
accompanied by basic remembering and re- 
calling routines which are a function of the 
structure of the memory rather than the list 
processing language employed. However, the 
programmer still decides what to remember 
and when to recall the information. 

In addition to devising a system through 
which the program can be manipulated, it is 
necessc-rv to provide contexters with the capa- 
bility of creating new programs based upon 
new generalisations inductively acquired; i.e,, 
the contexters should be programs which can 
create programs. Because the lowest level of 
detail in a computer model consists of basic 
processes which can be executed, i.e., the 
"abilities" possessed by the subject, all 
other levels of a computer model can be com- 
posed of the symbols which represent these 
basic processes. Hence, the procedure for 
creating new processes, plans, and contexters 
consists of restructuring these basic proc- 
esses in an appropriate order. However, if 
the context routines are to have the capability 
of creating plans, they must "know" or be able 
to ascertain the capabilities of the basic 
processes and of the higher level routines 
which derive from them. There is a crucial 
and as yet unresolved requirement for being 
able „o describe the characteristics and capa- 
bilities of a behavior regardless of the level 
at which it appears in the computer model. 

One rudimentary way is to consider a process 
as a transformation and use its inputs and 
outputs to describe the nature of the trans- 
formation. However, Newell [1962] indicates 
that this is not an adequate description- It 
would appear that the most feasible method 
would be to design computer models which 
manipulate verbal material as in the linguistic 
approach described in Chapter III. Regardless 



of how the description problem is solved, it 
is quite clear that unless it is solved, pro- 
gress in computer models will be very slow. 
It would appear that Newell's "solution by 
understanding" requires a prior "solution by 
description." 



Programming Techniques 

A number of computer programming tech- 
niques were developed by the project staff. The 
foremost of these techniques was the pseudo- 
code interpreter system which enables repre- 
sentation and execution of the model as a list 
of symbols. The pseudocode scheme also pro- 
vides the mechanical basis for the capability 
of the contexters to create programs from exist- 
ing programs; a major unsolved task is the 
conceptual basis for such a capability. 

The circular memory structure and its gen- 
eralized remembering and recalling routines 
hopefully provide the basis fa- future computer 
programs which can perform these processes 
without human supervision. Again the mechanics 
have been provided but the requisite knowledge 
upon which to base the processes is not avail- 
able. 

The development of computer programs in 
which the program can be treated as data and 
new behavior sequences can be created requires 
that the computer model be independent of the 
mechanics of the language in which it is coded. 
In any programming language there are a large 
number of necessary housekeeping tasks which 
are unrelated to a computer model of cognitive 
behavior. For example, in IPL-V one must erase 
unneeded lists, push 6. id pop the HO communi- 
cation cell, and make copies of lists. If the 
computer program is to truly be a model, it 
should not be cluttered by additional features 
which take account of the housekeeping details 
associated with the underlying programming 
language. Freedom from such mechanical de- 
tails can be accomplished through the use of 
an interpretive system, such as the pseudo- 
code in the Baker-Martin 1. 1965a! scheme. 
Alternately, if a "solution by description" were 
achieved, it could serve as the basis for the 
development of a compiler-level modeling lan- 
guage. One could then model the cognitive 
behavior in this language and be freed from the 
underlying list processing or other such lan- 
guage. Regardless of the method, the computer 
model needs to be freed from the housekeeping 
mechanics of the underlying programming lan- 
guage. 
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RESEARCH IDEAS GENERATED 
BY THE COMPUTER MODEL 

1. In that the total computer model was 
developed around the idea of a strategy or 
plan, there exists a need for more information 
on what processes a subject uses to create 
plans and on the role of instruction in forming 
such plans. As was observed above, the pres- 
ent computer program assumes that the ex- 
perimenter's instructions have a crucial role 
in the establishment of at least a gross plan 
of behavior. Unfortunately the planning ex- 
periment did not indicate that various levels 
of completeness of experimenter's instructions 
had any effect. Nonetheless the basic validity, 
or lack of validity, of the Miller, Galanter, and 
Pribram [ 1960} plans has not been demonstrated. 

Z. When one considers the vast realm of 
behavior which human beings are capable of 
exhibiting, it is remarkable that in a given 
situation they normally produce behavior rele- 
vant to the problem at hand. It may not be 
effective in a given situation, but usually it 
has some possibility of being useful. One of 
the outstanding features of the protocols was 
that almost all of the subjects very quickly 
produced a plan for solving concept-attainment 
problems. If subjects had not been able to 
select behaviors rapidly and appropriately, it 
would have taken a much greater period of 
time for them to solve these types of problems. 
Therefore, an important area of research is 
how humans select a specific behavior from 
their repertoire of possible behaviors. 

3. In that the communication between the 
experimenter and the subject is minimal in the 
concept-attainment experiments, it is unusual 
that subjects can maintain a sense of goal- 
directedness during the entire experiment in 
the absence of many external clues. The re- 
lationship between what the subject sees as 
the task to be accomplished and the kinds of 
information he utilizes to ascertain whether 
he is making progress toward that goal needs 
to be investigated quite carefully. Analysis 
of the protocols showed that most subjects 
had some understanding of whether or not 
they were going in the correct direction de- 
spite the lack of external clues. It would be 
very interesting to ascertain what types of 
internal information they were utilizing to 
maintain this goal-directedness. 

4. The memory entry point which was 
created to maintain some sense of order in 
the circular memory structure raises many 
questions about how people store information 
and, more importantly, how they get it back 
once it has been stored. The nature or struc- 



ture of information stored in the human brain 
is not intuitively obvious. Subjects are adept 
at getting the information at the proper time 
without any great amount of visible effort. 
Logical analysis of the concept-attainment 
problem suggested that people followed some 
type of memory entry point sequence in that 
they tend to remember information about what 
they are currently working with without much 
concern for the details of the previous opera- 
tion. However, many alternative models are 
equally reasonable. 

5. Much effort was devoted to trying to 
introduce within-problem variability into the 
computer model. It was severely hampered by 
a lack of understanding as to how people make 
errors. Stimulus— response psychology has 
traditionally blamed errors upon the stimulus 
materials; however, our model tends to indi- 
cate that these errors are more likely due to 
errors in the contexting operations and errors 
in internal description rather than in the stim- 
ulus materials themselves. It would be most 
helpful for someone to conduct experiments 
which try to obtain some understanding of how 
humans make errors in the internal processing 
of data. 

6. One of the large what one might call 
fudge factors in the current program was the 
awareness flag developed after the protocols 
showed that many subjects inadvertently 
worked with less than the full set of dimen- 
sions. In some cases it was clearly a per- 
ceptual problem; in other cases, it was possibly 
an oversight. If a subject was asked to name 
the dimensions, he would menti n all five, yet 
in working on a given problem, he might deal 
with fewer. The behavior raises a question of 
how people decide upon using less than the 
full information. There are two sides to this 
coin, one of which is when the subjects know 
they are using less than the full amount of in- 
formation and the other is when they do not. 

The interesting facet in the latter case is why 
don't they know? 

7. Analysis of the protocols indicated 
very clearly that people do not remember the 
sequence of object choices; rather they remem- 
ber strategies and reconstruct rather than re- 
call the sequences. Such an observation 
raises many questions about the concepts cur- 
rently in vogue about memory and what is 
stored. The protocols led to the distinct im- 
pression that people remo Tiber extremely little 
detailed information but do remember with 
great fidelity the strategies, procedures, and 
processes necessary to reconstruct the se- 
quence of events. It appears that people keep 
detail around just long enough for it to be of 
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some use. However, any information stored 
for a longer period of time is usually stored 
in the form of a procedure, i.e., a strategy 
accompanied by enough basic information to 
repeat the process itself. Such a conceptuali- 
zation of memory enhances the idea of the 
working memory and short-term memory, where 
working memory keeps the details just long 
enough for them to be used and short-term 
memory keeps enough of the salient informa- 
tion so that the process can be repeated. It 
would appear that the long-term memory is 
devoid of a great amount of detail but contains 
strategy lists and the necessary and sufficient 
amounts of crucial information to execute the 
strategy. However, the mechanisms by which 
people reconstruct rather than recall are not 
obvious and seem to be a good topic for future 
research. 

8. During the development of the short- 
term memory, it was observed that the informa- 
tion was stored in a highly interlinked fashion, 
no matter what structure of memory was used. 
The existence of such extensive interlinkage 
seemed to suggest that interference in memory 
could be caused by access to inappropriate 
information resulting from the excessive link- 
ages of the stored data. It would be very in- 
teresting to perform some experiments in which 
one deliberately caused subjects to remember 
certain types of linkages and then try to ob- 
serve the amount and nature of interference 
that occurs due to the preconstructed linkages. 

The types of information that are required 
for further development of the present com- 
puter model along the line s indicated suggest 
a rather different realm of psychological re- 
search than is usually reported in the litera- 
ture. The concern is with what the subject 
does rather than what the experimenter does. 

In most current psychological literature, the 
experimenter is actually varying the material, 
etc., and little other than relatively gross 
outputs is ever attributed to the subject. 

The protocol analyses have shown that these 
gross outputs are not really informative about 
the processes, procedures, and so on utilized 
by the subject. In essence what is needed is 
some research in depth as to what subjects 
do in experimental situations rather than 
what they produce - 



THE STATE OF OUR ART 

The listing of Mark IV, Mod L is provided 
as Appendix C and includes a symbol cross 
reference. The program was included to en- 
able those familiar with IPL-V to match what 



was said about the program with what the pro- 
gram actually does. Adequate documentations 
of large, complex computer models is a diffi- 
cult task and many discrepancies will probably 
be noted. 

One of the unfortunate realities of com- 
puter modeling research is that it is a very 
lonely endeavor. The total number of such 
researchers is very small, their distribution 
sparse, and their interests very specialized. 

It was difficult to conduct a meaningful dia- 
logue even with others interested in simulation 
of concept attainment, as each researcher has 
his own frame of reference and, once beyond 
generalities, such a dialogue requires intimate 
knowledge of the details of the models dis- 
cussed. Inadequate documentation of published 
computer models is partially at fault here, but 
in many cases adequately documented programs 
are complex and deviously interdependent so 
that what is said and what happens is dis- 
crepant. During the course of the present 
project Professors L. Uhr, L. W. Gregg, R. C- 
Calfee, R. L. Venezky, and the author held a 
series of informal faculty seminars in which 
it was possible to reach the level of detail 
necessary for meaiungful discussion of various 
computer models. These seminars were ex- 
tremely fruitful and are needed on a much 
broader scale if the field is to progress. 

Looking back to the beginning of the 
project, it can be seen that considerable pro- 
gress has been made. With each new version 
of the corapuLcr program, the problems attacked 
were more sophisticated and the unsolved prob- 
lems exposed more irretractable. What was 
once conceived of as a simple problem in com- 
puter application has become an extremely 
complex problem requiring answets to ques- 
tions which are far beyond existing knowledge. 
At present a complete restructuring of the con- 
ceptual basis of the program from plans and 
strategies to language processing appears to 
be required. The linguistic approach coupled 
with many of the techniques derived within 
the present project would initiate a new ap- 
proach to the modeling of human behavior. 

Such an approach might prove to be the step- 
ping stone to the desperately needed new tech- 
niques for studying covert human behavior. 

The concept-attainment program currently 
available, namely Mark IV, Mod l t is a very 
rudimentary model of the concept— attainment 
process and of itself does not exhibit a great 
deal of what a specialist in simulation would 
call "interesting behavior." However, the 
author has not been overly concerned about 
this aspect as the computer program essen- 
tially represents a repository for ideas about 
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the concept-attainment process acquired to 
date, r rom this point of view, the program 
can be considered quite successful in that a 
reasonable understanding of at least the 
grosser mechanics of the concept- attainment 
process was obtained. In the modeling of the 
concept-attainment process, many problems 
have not boon solved, but the modeling process 
has provided a good idea of what problems 
need to be solved in order for further progress 
to be made. 

The sequence of events occurring within 
the present research project has followed a 
pattern typical of most computer modeling 
research, namely rapid early progress which 
suddenly reaches an asymptote of no progress. 
That this pattern exists was forcefully pre- 
sented by H. L. Dreyfus L 1963 1 in the RAND 
report entitled "Alchemy and Artificial Intelli- 
gence" where he drew the analogy between 
the alchemist's early success in extracting 
quicksilver from what appeared to be dirt, 
which resulted in a fruitless attempt to turn 
lead into gold, and the early success in the 
simulation field. An eady success-long term 
failure pattern has been observed in nearly 
all aspects of computer modeling — problem 
solving, learning, chess playing, theorem 
proving and so forth. Dreyfus felt that simu- 
lation of cognitive processes reached their 
developmental asymptote very quickly and 
that future progress was limited by the in- 
ability of present computers and computer 



models to handle what he called "fringe con- 
sciousness, 1 By this term he means the wide 
array of subtle information which a human 
unconsciously draws upon when performing 
any cognitive task. Fringe consciousness 
would include information such as problems 
done in the past, psychological qualities of 
the experimenter's voice, remote prior ex- 
perience in other areas which can be trans- 
ferred to the present problem, and so forth. 
Dreyfus states that the range of such informa- 
tion is so great that, even if it could be 
enumerated, digital computers could not 
search it in reasonable time. The present 
computer model encountered the fringe con- 
sciousness problem and many of the "fudge" 
factors were simply attempts to avoid the 
problem. It appears that the fringe conscious- 
ness problem is unsurraountable if attacked 
head on. The only reasonable solution would 
seem to be to develop some creative high 
level theoretical abstractions that enable one 
to circumvent the necessity of including a 
human's complete range of experience within 
a computer model. 

On the basis of the author' s experience 
with the present research and what Dreyfus 
has described as the typical pattern in most 
modeling of cognitive behavior, it is evident 
that future progress is going to be slow and 
require the expenditure of considerable in- 
tellectual effort. 



< 
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APPENDIX A 

THINK-ALOUD PROTOCOL 



Problem I {Concept is short neck, bent tail) 

K: This card belongs to the concept. (Focus 

card is blue, s. neck, s. ears, b. tail) 

S: Ah, lets see it is blue and has a short 

neck, and has a straight tail. Ah 

E: This card. 

S: This ? 

E: Yea 

S: Short neck, straight tail 

£: No that tail is bent. 

S: Oh wait! 

E: See this has a straight tail. You can com- 

pare them. 

S: Oh, that's bent and that's straight. Alright, 

I was looking at this, so I the jht that 
this was the real bent one. 

E: Oh, I'm sorry. 

S: In other words these are the same cate- 

gories. 

E; Well I call them curly. 

S: So there is another category. 

E: There are three kinds of tails yea. 

S: Let me see. 

E: Straight, bent, and curly. 

S: O.K., Ah 

£: Or you can call them what ever you want 

to. 

S: It has a bent tail, it's blue, short neck, 

short ears. Um. Let me see, uh 

E: What are you looking for ? 

S: I'm looking for the same thing in another 

color to see if color is one of the cate- 
gories, one of the characteristics. Is this 
the one? It's brown, has short neck, and 
bent tail, (brown, s. neck, s. ears, b. tail, 
varying only color) 

E: Yes, that does belong. 

S: So then it doesn't matter what color it is. 

Um, I'll find one in yellows to see if . . . 

I can see this one in yellow. Does that 
belong (yellow, s. neck, s. ears, b. tail, 
varying only color again) 

E: Yes that belongs. 

S: Well, three of them are the same exactly 

except they're in different colors, there- 



fore, the one I’m looking for . . . it doesn't 
matter what color the one I'm looking for 
is. So the characteristics are, let me see, 
um . . . I'm going to find out if the tail has 
to be bent or not, so I'll take one that has 
a straight tail and no ears. 

E: What are you looking for ? 

S: I'm looking for, oh, here's one with a 

straight tail, and big ears. Oh wait, a 
straight tail and small ears. Does that 
fit in ? (brown, s. neck, s. ears, str. tail, 
varying color and tail) 

E: No, that does not belong. 

S; So obviously the tail is the one, the char- 
acteristic that uh, rules that one out. 

Does this belong ? It has a long neck and 
a curly tail, (brown, 1. neck, s. ears, 
curly tail, varying color, neck, and tail. 

But S should have learned that tail is 
relevant) 

E: No that does not belong. So now what are 

you thinking? 

S: I'm thinking that, well, something with a 

curly tail does not belong in the category. 
Is it possible that the card I'm looking for 
must have any color, must have a bent 
tail, and no neck, and short ears, or short 
neck and short ears. 

E: Are you gu ?ssing at it now? 

S: Well Uh-hum actually I am. 

E; Would you mind repeating it. 

S: Bent tail, short neck, no oars, uh, short 

ears, and it doesn't matter what color it 
is. 

E: No it is not correct. 

S: Well I will try and rule out some other 

category. Does uh. Does this belong? 

Has all the characteristics that the first 
part had, but it has big ears. Does this 
belong? (blue, s. neck, 1. ears, b. tail, 
varying just ears) 

E: Yes it does belong. 

S: Oh, so big ears are part of the category. 

Uh. Does this belong ? (blue, s. neck, 

1. ears, curly tail, varying ears and tail. 

S doesn't seem too sure of tail) 



E: Why are you asking? 

S: Because it has big ears, and a curly tail. 

E: No that does not belong. 

S: Then the curly tail must be a characteristic 

that doesn't belong. Does this belong ? 

Has a straight tail and big ears, {blue, 

1. neck, 1. ears, str. tail, varying neck, 
ears, and tail) 

E; No that does not belong. 

S: Then a straight tail does not belong. Well, 

then after searching out all the character- 
istics, I feel that the card I'm looking for 
must have any color, but it must have a 
bent tail, and a short neck, but it can have 
any kind of ears. 

E: That is correct. Uh-hum, O.K. 



Problem 2 {Concept is yellow, long neck, curly 
tail) 

E: This card belongs to the concept. {Focus 

card is yellow, 1. neck, s. ears, c. tail) 

S: Yes, it has a long neck, and it's yellow, 

and it has a curled tail, but has no ears. 
Now I'm going to test for, color I think 
first. Uh. Here is the same thing in blue, 
long neck and curled tail, and small ears. 
Does that fit? {blue, 1. neck, s. ears, 
c. tail, varying just color) 

E: No that does not belong. 

S: So obviously it has the same characteris- 

tics, but a different color, then the color 
rules it out. Does this belong ? Oh, wait 
now I'm sorry. 

E: What are you looking for? 

g. A brown animal with long neck, small ear-s, 
and a curled tail. But I don't seem to 
find one. Here's one. Does that fit into 
the category? {brown, 1. neck, s. ears, 
c. tail, varying color again. In all these 
problems, S always varied color first and 
checked it twice.) 

E: No this does not. 

S: Well I tested for the two other colors 

shown on the chart therefore, I feel that 
color is a characteristic that rules an 
animal out, so the color of an animal 
must be yellow. Now I will check for the 
size of the neck. Uh. Here is the same 
card, but only that it has a small neck, 
same animal. Does that fit in? {yellow, 
s. neck, s. ears, c. tail, varying only 
neck) 

E: No that does not belong. 

S: Well then the si2e of the neck is another 

characteristic that I'm looking for. It 
must have a long neck. Uh. The same 
card with a long neck, and big ears. Wait 
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now I'm sorry. Here, does that card be- 
long ? (yellow, 1. neck, 1. ears, c. tail, 
varying only ears) 

Yes, it does belong. 

So it doesn't matter what size the ears 
are? Here is an animal. I’m looking for 
an animal with a short neck to see if it is 
the size of the neck. {But S just checked 
the neck) Oh here, well it has a curled 
tail. Oh does this animal fit in it has a 
bent tail? (yellow, s. neck, s. ears, bent 
tail, varying neck and tail. S is either 
not paying attention or he has a very short 
memory.) 

No this does not belong. 

Does the 

What did mat tell you? 

Well it told me that, oh wait, I haven't 
tested really for a bent neck. Does this 
card with the short neck and curled tail 
fit in? Yes it does, (yellow, s. neck, 
s, ears, c. tail, varying neck. Same as 
3rd choice. It seems that S forgot the 
designation rather than forgot he chose it.) 
No it doesn’t. 

Oh, it doesn't! 

Did you forget this ? 

Yes I forgot that. So the size of the necx 
does matter. Uh. I'm looking for, oh here's 
one. An animal with no ears, a long neck, 
and a bent tail. Does that belong? (yellow, 
1. neck, s. ears, b. tail, varying just tail) 

No it doesn't belong. 

Well that tells me that the bent tail is out. 
Now I'm looking for an animal who has a 
long neck, and a curled tail, and no ears. 

It there one? Oh, it's the only one there. 

I think that I have found it. The animal 
must be yellow, must have the curled tail, 
must have a long neck, and must have no 
ears, or small ears. 

Short ears? 

Short ears. 

No that's not correct. 

Oh wait, 1 think that I tested for the ears. 
Then it must have all the characteristics, 
but it doesn't matter what ears. 

O.K. (Laughed) That's better. 



Problem 3 (Concept is brown, short ears) 

E: This card belongs to the concept. (Focus 

card is brown, 1. neck, s. ears, b. tail) 

S: It is a brown animal, it has a long neck, 

it has short ears, and a bent tail. Uh, I 
would like to test for color first, so I 
will find the same animal in a different 
color, and, see, long neck, bent tail, and 
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no ears, urn. Does this animal fit in ? 
(blue, 1. neck, s. ears, b. tail, varying 
color) 

E: Uh. No this does not belong. 

S: Well obviously the blue animal with the 

same characteristics doesn't fit in, so I 
will look for a brown animal, and see if 
that fits in. The same characteristics. 

Oh I mean a yellow animal. Does this 
animal fit in? (yellow, 1. neck, s. ears, 
b. tail, varying color again) 

E: No it does not belong. 

S: Well that tells me that color is a charac- 

teristic that rules an animal out. Now I 
will look for the same animal with a 
straight tail. Does this animal fit in, the 
same color, but a straight tail ? (brown, 

1. neck, s. ears, str. tail, varying only 
tail) 

E: Which one? Yes that does belong. 

S: So it does not matter if the tail is bent or 

straight. I will find one with a short neck. 
Does this animal fit in ? (brown, s. neck, 
s. ears, str. tail, varying neck and tail) 

E: Yes that does belong. 

S: It doesn't matter if the neck is short or 

tall, but this animal does have short ears. 

I will find one with big ears. Does this 
animal fit in? (brown, 1. neck, 1. ears, 
str. tail, varying ears and tail) 

E; No it does not. 

S: Well I feel that the animal must be brown, 

and must have long or short neck, and 
must. . . Oh, I haven't tested for a curled 
tail yet. Does this animal fit in? (brown, 
s. neck, s. ears, curly tail, varying neck 
and tail again) 

E: Yes it does belong. 

S: Well then the animal must be brown, must 

have a long or short neck. Must have, 
well it doesn't matter what size neck, or 
what kind of tail it has, but it must have 
small ears. 

E: O.K., that is correct. Um-hum. (S fol- 

lows a conservative strategy and varies 
all the values of a 3 -valued dimension) 



Problem 4 (Concept is brown, short neck, 
straight tail) 

E: This card belongs to the concept. What 

is the first thing you think of when I 
point a card out to you? (Focus card is 
brown, s. neck, s. ears, str. tail) 

S: What do you mean the characteristics, or 

just the first. . . 

£: Well the first thing you think of. 

S: I k hink of a dachshund. It looks like a 

dachshund. 



E: (Laughed) NO, I mean, you know, 

S: Brown is the first thing, and the fact that 

it has a short neck, and no ears, so I think 
that is pretty important, and a straight tail 
and no other characteristics. Uh. 

E; Then what do you think ? Continue 
S: I'm trying to decide. I'm looking for a card 

that's the exact same thing but a different 
color, and here is one in blue, (blue, s. 
neck, s. ears, str. tail) 

E: No this does not belong. 

S: Well I will find one in yellow and see if 

yellow belongs. 

E: You usually test color first? 

S: Yes I do. I think that is a good way to 

start anyway. I guess it really doesn't 
matter, it is the easiest, I feel, if you 
differentiate in color because then you 
can look for other characteristics. Does 
this animal, yellow one fit in ? (yellow, 
s. neck, s. ears, str. tail) 

E: No it does not belong. 

S: That tells me that the animal that I'm look- 

ing for must be brown, so it narrows down 
the field, it is very easy to find animals 
by color rather than other characteristics, 
which aren't as visible. Uh. I'm checking 
the tail. Does this animal fit in? Oh 
wait, I'm sorry. I'm looking for a short 
neck. Does this animal fit in? (brown, 
s. neck, s. ears, b. tail, varying just tail) 

E: No it does not belong. 

S: Tells me that the tail must be straight. 

Does this animal fit in ? The straight tail 
and long neck, (brown, L neck, s. ears, 
str, tail, varying just neck) 

E: What do you want to find out? 

S: The neck. 

E: No that does not belong. 

S: It tells me that the neck must be short. 

Does this animal fit in ? It has big ears, 
(brown, s. neck, i. ears, str. tail, varying 
just ears) 

E: Yes it does belong. 

S: Well that tells me that the animal must 

be brown, must have a straight tail, must 
have a short neck, and big ears. (S hafc 
Just described the last card he has chosen.) 
E: And big ears ? S 

S: No, small ears. Oh wait it doe^n'tmatter 

what ears. i--' 

E: O.K. That is correct. 



Problem 5 (Concept is short ears) 

E: This card belongs to the concept. (Focus 

card is blue, s. neck, s. ears, curly tail. 

S: It is a blue animal with a curled tail, short 

neck, no ears. I'm going to check the 



color first so it is the ssros animsl but a 
different color, (brown, s. neck, s. ears, 
c. tail, varying color) 

Z: Uh-hum. Yes it does belong, 

g. Brown belongs. I’ll see if yellow belongs 
too. (yellow, s. neck, s. ears, c. tail) 

E: Yes that does belong. 

S: Then that tells me that it doesn’t matter 

what color it is. I will check for the tail 
first. Does this animal fit in? (yellow, 
s. neck, s. ears, b. tail, varying color 
and tail) 

E: Yes that belongs too. 

S: Well then that tells me that it doesn’t 

matter if the tail is bent. Does this ani- 
mal fit in? Let me see I’m looking for a 
curled tail. Oh wait that is a curled tail, 
I’m sorry, I'm looking for a small animal 
with a straight tail. Here it is. Does 
this animal fit in? (blue, s. neck, s. ears, 
s tr. tail, varying tail. Usually after check- 
ing both other values of color, S checks 
both other values of tail.) 

E: Yes it does belong. 

S: So that tells me that it doesn’t matter 

what color it is or what kind of tail it 
has. Now I'm checking for a long neck. 
Does this animal fit in ? Has a long neck, 
(yellow, 1. neck, s. ears, c. tail) 

E: Yes it does belong. 

S: Then that tells me that it doesn't matter 

what neck it has . Does this animal fit 
in? (yellow, s. neck, 1. ears, str. tail) 

E: Why are you asking that ? 

S: It has the characteristics that are accept- 

able. But it has big ears, and I haven’t 
checked for that yet. 

E: No that does not belong. 

S: That tells me that the animal may be any 

color, and that it may have any size neck, 
may have any kind of tail, but it must 
have small ears. 

E: That is correct. 



Problem 6' (Concept is curly tail) 



E; 



S 

E 

S 



E: 

S: 



That card belongs to the concept. (Focus 
card is brown, short neck, s. ears, c. tail) 
That one. 

Yes. 

Uh. It has a short neck, small ears, and 
a curled tail, and it's brown. I will find 
the same thing in a different color. Lets 
see. Wait. Does this fit in? (blue, s. 
neck, s. ears, c. tail) 

Yes it does belong. 

Does this fit? (yellow, s. neck, s. ears, 
c. tail) 
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Yes it does. 

That tells me that it doesn’t matter what 
color is it. I'm looking for the size of the 
neck now. Does this fit in ? (yellow, 

1. neck, s. ears, c. tail, varying color and 
neck) 

Yes it does belong. 

That tells me that it doesn’t matter what 
size the neck is. Does this fit in? (yel- 
low, s. neck, 1. ears, str. tail, varying 
color, ears, and tail) 

No that does not belong. 

Ah wait that doesn't tell me anything be- 
cause there are two different character- 
istics, I should have pointed to something 
else. Does this fit in? Oh wait, yea, 

Does this fit in? (blue, s. neck, 1. ears, 
c. tail, varying color and ears) 

What are you trying to find out? 

What size the ears are. 

Yea that belongs. 

That tells me that it doesn’t matter what 
size the ears are. Does this fit in? (blue, 

1. neck, 1. ears, c. tail, varying everything 
except tail) 

Yes that belongs. 

Well thats for the long neck. Now have I 
tested for even ,, Mng else ? Does this fit 
in? (blue, 1. 'k, 1. ears, b. tail, varying 

everything. S should have known the con- 
cept Z choices ago.) 

Which one, the blue one? 

Yea. 

No that does not belong. 

Does this fit in, with the straight tail? 
(blue, s. neck, s. ears, str. tail, varying 

color and tail) 

No that does not belong. 

That tells me that I'm looking for an ani- 
mal that can be of any color, can have any 
size neck or any size ears, but must have 
a curled tail. 

That is correct. O.K. Tell me what your 
impression of this board is and the pro- 
cedure ami everything. Any thing you 
would like to comment about. 

Uh-hum. I think it is a good way to test, 
well first of all the colors are good be- 
cause I think you can differentiate between 
them pretty easily, ami so that is the im- 
mediate stimulus I guess. The immediate 
thing that I see is a difference in color 
the first thing , and then if yc i distinguish 
between the colors first then you can find 
the different characteristics. It can be 
sort of confusing , forgetting if it has a 
bent tail, straight. I really don't see the 
purpose of it all. Unless it is an 1.0 . or 
something. 






» 



E: Well this is just to see the little detailed 

thought processes that is behind solving 
problems like this. 

S: Uh-hum. 

E: That is all that you have to say on the 

subject? 

S: Yea I think so. 

E: What is your general strategy of solving 

the problem i 

S: Well first I try to solve the problem with 

color. I think that it is easiest to differ- 
entiate, between colors, and then X usually 
look for neck first, and then, because that 
is another easy to differentiate because 



it is outstanding , and then for the tail, 
and the oars, it aoesn't really matter 
which way you go about it because they 
are both equally as easy to see. 

E; Uh-hum. Q.K. That will be all for today. 
(S always picked color first. Then he 
would pick tail, not neck, in ±/s of the 
problems. After that, nock, the-n oars. 
This S had been run initially on the old 
board of circles and triangles on colored 
paper. That is where he developed his 
conservative strategy. I ended this ses- 
sion early because S was getting very 
bored by that time.) 
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APPENDIX C 

NARRATIVE DESCRIPTION OF MARK IV, MOO 2 






C 1 1 Control Contexter Program is to de- 
cide what type of a message is coming 
in and assign it to the proper decoder. 
Receive message from experimenter 
(automatic copy of input) and save 
the message. Determine the message 
type and save its value. Use the 
value of the message type to select 
a proper contexter. Execute the se- 
lected ccntexter. 

C50 Include problem details in dummy 

description list. (The message was 
a problem -detail type.) Save the mes- 
sage (automatic extract name of 
dummy description list from message 
list body) information. I shall call 

the problem . I shall call the 

external world . Describe the 

problem by my name for the external 
world. The structure of the relation- 
ship between dimension values arid 
dimensions of the external world are 
given by MI3. Describe my name for 
the external world by this structure. 
Describe the problem by the problem 
details which 1 had saved. 

Is this the first problem solution 
attempt? If yes, I shall call my 
strategy . Describe the prob- 

lem by the name of the strategy. If 
no, recall the name of the most re- 
cent strategy used (obtained from 
long-term memory). Describe the 
problem by the name of the strategy. 
Use the name of the problem as a 
memory tracer. 

C5 1 The message is a doing type. Save 
the message information (automatic 
extraction of ddl from message body). 
Get the description of the problem 
which names my strategy. Create a 
name for this behavior. Describe 
the name by the message information. 
Add the name of this behavior to the 
strategy. 



0 




C52 The message is a designation type. 

Save the message information 
(automatic extraction of ddl from mes- 
sage). The possible values of the 
experimenter's designation replies 
will be yes or no. Add this informa- 
tion to my general store of information. 

C60 Recall my most recent strategy and 

recall the skeleton outline of the cur- 
rent problem. Is this the first prob- 
lem? 

No — execute the most recent 
strategy, then remember it. 

Yes — create a name for the new 

strategy and save the name. 
Create linkage to beginning of this 
phase and save linkage. Now I must 
compare desired behavior with exist- 
ing behavior and fill in the strategy. 

To do this I must (Sub Process ) . 

Sub Process 

Compare descriptions of behavior 
on skeleton strategy with existing 
behaviors. Can I find a match? 

No — error. 

Yes — save name of behavior, add 
name of this behavior to the 
new strategy list. 

Does tills behavior receive informa- 
tion from the external world ? 

No — (Go to 9-4). 

Yes — Is external information a 
designation ? 

Yes — Determine type of desig- 
nation. 

No — Determine what type of 
external information is 
received. 

Now that information type has been 
determined, I must get contexter for 
that type. Add name of contexter to 
the phase (automatic next upper link- 
age insertion). (Insertions pf con- 
texter implies end of phase so that 
the behavior can be executed.) Now 
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execute the behavior phase just cre- 
ated. Save results of decision (all 
phases end with a decision output 
of yes or no). Save name of phas^ 
just executed. Was the last behavior 
on the Phase list a decision-type 
behavior? 

No — Exit sub-process. 

Yes — Link the no response to the 
first phase. Link the yes 
response to the correct phase. 
Create new yes link. 

Was result a previous decision a 
No — Execute phase linked to 
the No. 

Yes — Exit from sub-process. 

[9-4j Is behavior-type a decision? 

No — Exit sub-process 

Yes — Has phase already been 
executed ? 

[Note either a contexter or a decision, 
continue implies phase execution.) 

No — (Go to phase execution). 

Yes — Execute just the decision 
behavior, erase temporary 
storage. 

Go to 9-16. 

C20 Create Z7 

Information has been received from 
the external world. I must save where 
I am in the problem sequence so that 
I can return to this point later. Is the 
next behavior in the plan described 
like a Z7 behavior? 

Yes — Exit this contexter. 

No — Create a name which is de- 
scribed the same as Z7. 

Place this name in the saved problem 
sequence. Use name of the present 
contexter to get name of phase, save 
the name of the phase. Get name of 
Z7 behavior. Add behavior which cre- 
ates a working hypothesis. Add be- 
havior to remember the working hy- 
pothesis (P191). Add behavior which 
will trace working hypothesis (C31). 
Add behavior to remember how the 
working hypothesis was formed. Add 
a decision behavior which decides if 
I can proceed to the phase (D4). De- 
scribe the phase to show that Z7 has 
been added to the phase. Describe 
the phase to show that D4 has been 
added to the phase. 

C36 Verify object choice. 

Save where I am in the problem solu- 
tion. Obtain next behavior in the 
sequence. Is it described as a D- 
type routine? 



Yes — Exit contexter. 

No — Create a name for a behavior 
which is described as a DO 
routine. Add the DO behavior 
to the phase list (automatic 
next upper added to DO). De- 
scribe the phase list by the 
addition of DO. 

C3S-9 Create reaction to object designation. 
Save where I am in the problem se- 
quence. Save the current memory entry 
point. Use name of contexter to ob- 
tain name of phase. Save the phase 
name. Create and save name for a 
routine described the same as a Z4 
routine. Is the next behavior in the 
solution sequence described the same 
as Z4? 

Yes — Delete the matching name 
from the problem sequence. 

No — Add symbol for Z4 behavior 
to the phase list. 

Describe phase list by addition of 
Z4 behavior. 

Get experiment's designation of 
the object choice. Was it designated 
a yes? 

Yes — Establish a routine to remove 
irrelevant dimensions, as the 
appropriate behavior, save 
name, (Go to 9-4). 

No — Establish a routine to revert 
dimensions as the appropriate 
behavior, save name. 

Is the subject aware of dimension 
varied ? 

No — (Go to 9 -4). 

Yes — Was one dimension varied? 

Yes — (Go to 9-4). 

No — Add routine to retrace 
memory one level to the 
Z4 routine. Then exit 
contexter. 

9-4 Add to Z4 a behavior to retrace 

memory one level. Add to Z4 a be- 
havior to mark the dimension values. 
Add to Z4 a behavior to mark the 
dimensions. Add a routine to recall 
the experimenter's designation of 
the object. Add appropriate dimen- 
sion handling routine to Z4. Exit 
contexter. [Note: This routine is 
not consistent with the other rou- 
tines.] 

[Note: The interpreter must check for con- 
texter and if so will put CIA in (0), along 
with other inputs.] 
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Set up reaction to concept designation. 

Save where I am in the problem se- 
quence, obtain the next behavior in 
the problem sequence and determine 
it its designation matches that of a 
Z6 behavior. 

Yes — Delate behavior from problem 
sequence. 

No — Obtain experimenter's desig- 
nation of the concept. 

If it is a 

Yes — Exit from contexter. 

No — Create a symbol described as 
a Z6 behavior. 

Add new Z6 to the execution list. 

Use name of contexter to get name of 
phase. 

Describe phase by addition of Z6 
behavior. Get the focus object and 
determine if any unmarked dimensions 
exist. 

Yes — Set to add routine to which 
finds unmarked dimensions. 

No — Set to add routine which finds 
irrelevant dimensions. 

Save name of appropriate routine. 

Add routine to Z6 which retraces mem- 
ory one level (C41). Add routines to 
retrace memory one level. Add appro- 
priate routine from above (Q41, Q42). 
Ado routine to add dimension to work- 
ing hypothesis . Add routine to Z6 
which remembers modified working 
hypothesis. Is the subject aware? 

Yes — Correct focus object dimen- 
sionality. 

No — Set dimensionality to unity. 

Set routines which add dimension to 
above dimensionality. Exit contexter. 

ZO Problem specification 

P21 — Copy focus. 

P61 — Remember copy of focus object. 
P31 — Put name of focus copy in MEP. 
P62 — Remember set membership of 
focus copy. 

P21 Copy focus object. 

Get the name of the focus object from 
working memory, save the name. 

Get a dimension value, use dimen- 
sion value to get dimension. Use 
dimension to get the list Ml 3. Make 
a copy of focus object in DAV order 
(R190). Give this copy a name, place 
name in MI,N. Exit subroutine. 

[Note 1. This should be mostly 
within the subject. I think we should 
change program so that E routine 



gives an una escribed focus with 
internal name so that subject docs 
not have to copy it. | 

[Note 2. This routine is really un- 
necessary if we implement Nolo l.| 

P60-1 Attach (M1,X) to value list of class 
attribute (2) of list (i) (0) = Hay. 

Input Ml 5 
Output M j, A220. 

Note that whatever is named in con- 
tents of MEP gets described. Remem- 
ber . The item of information in 

working memory is stored as a value 
if an attribute describing the symbol 
contained in the memory entry point. 

C31 Trace 

The name contained in working memory 
is placed in the memory entry point 
so that one can trace the problem path 
in memory. 

P62 Remember . Remember that the 

focus object is a member of the set, 
i.e. the ddl in working memory is 
stored as the value of an attribute 
describing the focus object. 

Z7 Create a working hypothesis 

P191 — Create working hypothesis 
from the copy of the focus 
object (CFO). 

» P63 — Remember working hypothesis. 

C31— Place WH in MEP. 

P64 — Remember how working hy- 
pothesis formed. 

P191 Make a working hypothesis having 

K99 dimensions. If the subject is not 
aware, this is a subject characteristic 
routine whic creates the WH. 

If the subject is aware, this routine 
is a legal doing -type routine. 

Get the focus object from MEP, cre- 
ate a copy. Remove those dimension 
values beyond the K99th. Find the 
dimensions corresponding to these 
dimension values. Create a descrip- 
tion list containing these dimensions. 
Save the ddl. Attach the dimension 
values under a "from" attribute. Store 
ddl in Ml, D. Store WH in Ml , N. 

Exit subroutine. 

P63 Remember working hypothesis. 

C3 1 Place name of working hypothesis in 

memory entry point. 

P64 Remember how working hypothesis 

. formed . 
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Z1 Create search criterion. 

P151 — Select dimensions to vary. 

p 14 1 — Select dimension values. 

p 1 5 1 — Vary dimension values. 

P64 — Remember how working hy- 
pothesis was varied. 

PI 51 Select dimensions to vary. 

Get the name of the WH from work- 
ing memory. Collect dimension 
values not designated and save this 
list. I will vary only K98 of these so 
discard the rest. 

Make a list of the dimensions cor- 
responding to the dimension values. 
Create a ddl for the dimensions. Add 
the list of dimension values to the 
ddl under a "from" attribute. Put 
name of WH in Ml, N. Put name of 
ddl in Ml , D. Exit from routine. 

Pi 40 Find new dimension values. 

Get the list in Ml, D describing 
what to vary, and save its name. 

Obtain value of the "from" attribute. 
Obtain the dimensions attribute. 
Generate dimensions and their values 
in parallel. 

Sub Process . I know the dimen- 
sion to vary and its original value. 
Obtain list of dominance values for 
the dimension. Set probability of 
dimension value negative (ignore 
dominant attribute value of this di- 
mension value). Choose most dom- 
inant dimension , jlue. If none, exit. 
Save this dimension value. Check 
to see if it has been designated. 

Yes — Pick up another dimension 
value. 

No — Make this DV a value of the. 
"to" attribute of the ddl saved 
earlier. Restore DAV values 
of the '’from' 1 and ”to" dimen- 
sion values ( seems peculiar 
should bein Z6 problem clean- 
up). Exit sub process. 

P151 Vary the dimensions of the working 
hypothesis. Save the name of the 
working hypothesis. Get the ddl 
containing the change information 
and save its name. Get the list of 
“from” dimension values. Get the 
list of "to’ 1 dimension values. Gen- 
erate the "from" and "to" dimension 
values in parallel 

Sub Process Get the name of WH, 
then replace "from" DV to the "to" DV 



[Note: Contents of Ml before P15 1 were WH 
and ddl, P151 manipulates the contents of WH 
but does not replace the contents of Ml. Per- 
haps we should standardize the end of a rou- 
tine to fill Ml,N, M1,D. 

P64 Remember how WH modified. Describe 

workinq hypothesis by the "from-to" list. 

Z2 Select an object. 

P51 — Find object matching search 
criterion. [Note: the search 
criterion is the working hy- 
pothesis after a dimension 
has been varied.) 

P65 — Remember the object. 

C31 — Place name of object in MEP. 

P66 — Remember how object found. 

P51 Save the inputs. Get and save the 
name of the search criteria. Search 
the external environment for object 
matching the search criterion (K2). 

Save the name of the matching object. 

Get value of change attitude ("from-to" 
list). Place name of change list in M1,D. 
Place name of object found in M1,N. 
[Note: We may want to systematize 
this by always using name for those 
symbols going into M1,N and descrip - 
Hons for those symbols going into 
Ml,D.j 

DO Verify object choice 

051 

Q51 Check object choice. 

Save inputs. Get name of object 
chosen. Recall the focus object. 

Make list of symbols. Determine 
which dimension values of the object 
are not on the focus object. Save 
name of this list. Get "from-to” list 
from the "how found" attribute. Get 
the value of the "to" attribute. Find 
which values the focus object ami 
"to" list do not have in common. 
Generate these values. 

Sub Process Check to see if 
dimension values are marked. 

No — Exit. 

Yes — Pop HO. 

Set output of Q routine ±. 

[Note: This program determines what 
focus object and card choice do not 
have in common. Then it checks to 
see that the non— common dimension 
values are not already marked rele- 
vant or irrelevant. If unmarked, this 
object is O.K.] 
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Zi Experimenter designates object. 

P71 — present object choice. 

E93 — experimenter designation. 

P6d — remember designation. 

P 71 Put name of object in the output chan- 

nel. Save inputs {MEP, El). Get 
name of object choice from MEP. 

Place name on output list EZ. 

~93 Experimenter checks to see if object 

choice contains concept, sets value 
of designation attribute yes or no 
and puts ddl in M1,D and name of 
object in Ml, N. 

P6Z Remember experimenter's designation 

of the object. 

Z4 React to object designation. 

P96 — mark dimension values. 

P91 — mark dimension 

C4 1 — pop to WH 

P 101 or P171 — delete or revert di- 
mensions of the 
working hypothesis. 

P96 Mark dimension values. 

Save inputs , set number of values to 
zero. Obtain experimenter's designa- 
tion of the object and save it. Get 
the working hypothesis and save it. 
Get the value of the "from-to" at- 
tribute and save the description list. 
Get the "from 1 ' dimension list. Gen- 
erate dimension value list. 

Sub Process Make experimenter 
designation an attribute value of the 
relevancy attribute. Save all (K96) 
dimension values required. Reverse 
H5. 

P91 Mark dimensions relevant-irrelevant. 

Save inputs. Get object description, 
get experimenter designation of the 
object choice and save it. Get the 
search criterion and save it. Get the 
"from -to" list of the search criterion. 
Get the dimension changed list and 
generate it. 

Sub Process Save the dimension. 
Check to see if all but one dimension 
value marked. 

No — Exit. 

Yes — Mark the dimension with 
experimenter designation. 

Check if done K96 uimensions. 

Yes — Terminate sub process. 

No — Continue. 

Place dimension varied description 
in Ml,D, place WH in Ml,N, exit 
routine. 
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P50.3 Recall set membership ( should be 501). 
Get value of set membership attribute 
of symbol named in MEP. Save inputs, 
got first symbol in MEP. Get first 
value off value list of (MEP) under set 
membership attribute. 

If none — exit. 

Put value in Ml ,D. 

Put symbol from MEP in Ml ,N. 

[Note: The general routine underlying 
this is P500 which enables one to find 
the first value on die value list of at- 
tribute of list . This is a 

very powerful routine which isn't used 
enough.] 

Pi 71 Revert working hypothesis back to 
original /form. Get name in Ml; get 
description. Obtain the value of the 
"to" attribute and save it. Obtain the 
value of the "from" attribute and save 
it. Generate ooth lists. 

Sub Process Replace the "to" 
value on the search criterion by the 
"from" value. 

Create a description; make old 
"from" list the value of the "to" at- 
tribute. 

Make the old "to" list the value 
of the "from" attribute. 

Hold description in working mem- 
ory. 

Hold search criterion in WM, 

P101 Remove irrelevant dimension from WH. 
Get WH from working memory; get its 
description. Obtain the value of the 
"from" attribute and save it. Obtain 
the value of the "to" attribute, save 
it. Obtain value of dimension attri- 
bute and save it. Generate both lists. 

Sub Process Save the dimension 
value from the "to" list. Determine 
if it is marked irrelevant. 

No — Exit sub process. 

Yes — Remove the corresponding 
"from" value of the working 
hypothesis. 

Create a description, make old "to" 
list the value of the "from" attribute. 
Add old dimens ion list as value of 
dimension attribute. 

Hold WH in M1,N. 

Hold ddl in M1,D. 

[Note: Perhaps the class attribute 
should be a varied attribute, "what," 
"from," "to" as the specific values.] 

D1 Can concept be presented? 

Q101 
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Q101 Get name of working hypothesis. 
Generate body of WH. 

Sub Process Get value of desig- 
nation attribute of the dimension 
value. 

If unmarked — exit. 

If marked — to next dimension 
value. 

If all dimension values marked, 
then concept can be presented. 

Z5 Form a concept. 

P 121 — Form concept. 

P67 — Remember concept. 

C31 — Transfer concept. 

P68 — Remember how formed. 

P121 Form concept. 

Get the search criterion (WH) and 
save it. Create name of concept. 
Create descriptions of concept and 
save it. Generate body of working 
hypothesis. (Sub process) 

Sub Process Save dimension 
value, determine if dimension is un- 
marked. If yes, exit. If no, save 
value of relevancy attribute and save 
dimension value. Was dimension 
value relevant? 

If yes — add value to body of 
concept. 

If no — exit sub process. 

Make working hypothesis the value 
of the basis attribute of the ddl. 
Place description in Ml .D# place 
concept in M1,N. 

Z8 Have concept designated. 

P72 — Present concept to experi- 
menter. 

E94 — Experimenter action. 

P69 — Remember designation. 
[Note: P72 is definition of present 
verb.] 



Zb Corrective action: 

C41 — Pop SC to WH. 

C4I— Pop WH to CFO 

Q41 — Find untested dimensions 
(or 042) 

p 1 8 1 — Add dimension. 

C31 — Place working hypothesis 
name in MEP. 

P64 — Remember what added. 

Q41 Find untested dimensions. 

Get and save copy of the focus ob- 
ject (in MEP). Make list of all di- 
mension values of CFO not marked 
DELETE all but K9 7 of the symbols. 
Find dimension corresponding to un- 
marked dimension values. Create 
description. Make list of dimensions 
the value of the dimension attribute 
(what). Add list of unmarked dimen- 
sion values as value of the "to H at- 
tribute of the ddl. Place name of 
CFO in Ml.N. Place description in 
Ml ,D. 

Q42 Same as Q41 except that R42 used 

instead of R41. R42 checks for match 

of both attribute and its value, hence 
to list irrelevant dimension values 
one needs attribute value- 

P181 Add dimensions to SC (WH in Ml.N, 
new DV list in M1,D). Get value of 
hypotheses attributes of CFO and 
save it(WH). Hold it in M1*N. Get 
Jhe description, obtain the “to" list 
from the description. Generate sym- 
bols on “to ” list. 

Sub Process Add symbol on “to" 
list to the working hypotheses. 

Place working hypotheses in M1,N. 
Place description in M1,D. 
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